-- Logs begin at Thu 2022-06-16 11:06:29 UTC, end at Thu 2022-06-16 12:14:48 UTC. -- Jun 16 11:47:17.661068 dv-cinder-846146-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 11:47:17.669851 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 11:47:17 2022] *** Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: nodename: dv-cinder-846146-2-iscsi Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: machine: x86_64 Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: clock source: unix Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: pcre jit disabled Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: detected number of CPU cores: 4 Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: current working directory: / Jun 16 11:47:17.671974 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: detected binary path: /usr/bin/uwsgi-core Jun 16 11:47:17.672587 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: your processes number limit is 47680 Jun 16 11:47:17.672587 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: your memory page size is 4096 bytes Jun 16 11:47:17.672587 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: detected max file descriptor number: 2048 Jun 16 11:47:17.672587 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: lock engine: pthread robust mutexes Jun 16 11:47:17.672587 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: thunder lock: enabled Jun 16 11:47:17.672587 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 11:47:17.672587 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 11:47:17.716804 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: Python main interpreter initialized at 0x562a1fbd89c0 Jun 16 11:47:17.716804 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: python threads support enabled Jun 16 11:47:17.716804 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: your server socket listen backlog is limited to 100 connections Jun 16 11:47:17.716804 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: your mercy for graceful operations on workers is 90 seconds Jun 16 11:47:17.717120 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 11:47:17.717229 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: *** Operational MODE: preforking *** Jun 16 11:47:17.717491 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: *** uWSGI is running in multiple interpreter mode *** Jun 16 11:47:17.717491 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: spawned uWSGI master process (pid: 110281) Jun 16 11:47:17.717676 dv-cinder-846146-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 11:47:17.719035 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: spawned uWSGI worker 1 (pid: 110282, cores: 1) Jun 16 11:47:17.719035 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: spawned uWSGI worker 2 (pid: 110283, cores: 1) Jun 16 11:47:17.719035 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 11:47:18.377473 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 11:47:18.378079 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 11:47:19.553706 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:47:19.553706 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: from cryptography.utils import int_from_bytes Jun 16 11:47:19.554341 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:47:19.554341 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: from cryptography.utils import int_from_bytes Jun 16 11:47:19.554716 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:47:19.554716 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: from cryptography.utils import int_from_bytes Jun 16 11:47:19.554830 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:47:19.554830 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: from cryptography.utils import int_from_bytes Jun 16 11:47:22.140251 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 11:47:22.140822 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 11:47:22.141014 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 11:47:22.141373 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 11:47:22.141631 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 11:47:22.142016 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.142335 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.142653 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.142965 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.143289 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.143596 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.143939 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.144257 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.144581 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.144838 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.144935 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 11:47:22.145289 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.145375 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 11:47:22.145459 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-2-iscsi {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.145688 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 11:47:22.145788 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.146044 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.146141 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 11:47:22.146304 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 11:47:22.146395 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.146647 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.146733 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.146947 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.147042 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.147263 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.147348 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.147562 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.147654 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.147972 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.148072 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.148292 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.148516 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.148633 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.148825 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.148953 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.149134 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.149265 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.149464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.149601 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.149773 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.149867 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.150080 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.150211 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-2-iscsi {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.150395 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.150488 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.150699 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.150784 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.151010 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.151115 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.151316 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.151403 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.151624 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.151728 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-2-iscsi {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.151971 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.152073 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.152312 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.152403 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.152659 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.152822 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.153065 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.153157 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.153380 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.153515 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.153705 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.153809 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.153999 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.154114 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.154313 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.154427 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.154609 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.154724 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.154932 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.155041 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.155245 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.155367 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.155559 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.155659 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.155859 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.155982 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.156194 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.156285 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-2-iscsi {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.156498 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.156618 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.156801 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.156893 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.157115 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.157213 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.157416 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.157581 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.157736 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.157884 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.157977 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.158193 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.158287 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.158519 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.158612 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.158847 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.158945 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.159160 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.159269 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.159419 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.159514 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.159656 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.159816 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.160012 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.160183 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.160353 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.160443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.160618 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.160830 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.160918 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.161067 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.161209 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.161357 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.161505 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.161672 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.161836 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.161984 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.162101 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.162284 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.162378 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.162541 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.162706 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.162849 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.162996 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.163161 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.163316 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.163484 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.163586 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.163799 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.163933 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.164087 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.164240 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.164335 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.164594 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.164693 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.164838 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.164926 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.165138 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.165244 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.165470 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.165562 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.165785 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.165933 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.166083 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.166227 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.166370 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.166514 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.166684 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.166839 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.166984 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.167121 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.167280 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.167421 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.167566 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.167703 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.168408 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.168556 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.168707 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.168845 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.169004 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.169155 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.169304 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.169451 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.169624 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.169852 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.170002 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.170226 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.170366 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.170513 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.170649 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.170791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.170937 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.171082 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.171219 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.171362 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.171498 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.171656 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.171793 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.171977 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.172124 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.172268 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.172491 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.172491 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.172765 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.172911 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.173057 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.173194 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.173329 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.173464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.173611 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.173762 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.173981 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.174126 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.174261 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.174405 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.174550 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.174698 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.174835 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.174969 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.175117 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.175260 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.175404 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.175557 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.175702 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.175853 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.176049 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.176186 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.176347 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.176494 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.176637 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.176773 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.176914 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.177050 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.177198 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.177335 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.177487 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.177624 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.177766 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.177906 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.178052 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.178190 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.178333 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.178476 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.178612 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.178746 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.178890 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.179026 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.179169 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.179323 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.179459 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.179604 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.179740 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.179906 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.180050 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.180187 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.180324 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.180472 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.180621 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.180758 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.180901 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.181046 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.181183 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.181327 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.181471 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.181608 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.181744 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.181887 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.182023 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.182170 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.182308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.182444 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.182666 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.182814 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.182974 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.183121 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.183268 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.183451 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.184233 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.184388 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.184527 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.184673 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.184811 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.184954 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.185091 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.185226 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.185371 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.185529 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.185668 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.185803 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.185939 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.186074 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.186219 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.186363 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.186500 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.186643 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.186780 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.186928 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.187073 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.187227 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.187374 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.187510 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.187658 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.187801 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.187986 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.188125 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.188262 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.188398 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.188533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.188678 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.188823 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.188960 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.189135 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.189287 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.189458 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:47:22.189618 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.189797 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.189948 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.190132 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.190276 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.190419 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.190563 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.190732 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.190886 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.191058 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.191217 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.191364 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.191501 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.191667 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.191816 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.192002 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.192151 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.192348 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.192500 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.192734 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.192882 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.193032 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.193195 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.193333 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.193482 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.193620 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.193756 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.193899 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.194043 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.194193 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.194422 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.194559 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.194701 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.194849 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.194999 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.195159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.195297 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.195433 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.195576 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.195714 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.195850 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.196044 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.196192 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.196329 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.196473 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.196609 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.196745 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.196898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.197045 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.197183 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.197327 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.197470 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.197622 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.197767 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.197917 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.198077 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.198266 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.198420 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.198572 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.198723 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.198890 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.199092 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.199247 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.199391 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.199546 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.199690 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.199833 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.200038 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.200183 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.200327 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.200482 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.200626 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.200779 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.200934 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.201078 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.201233 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.201378 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.201597 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.201743 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.201895 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.202046 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.202198 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.202343 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.202485 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.202628 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.202864 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.203035 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.203193 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.203338 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.203482 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.203632 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.203782 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.203950 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.204116 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.204267 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.204501 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.204652 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.204796 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.204951 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.205106 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.205249 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.205391 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.205543 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.205687 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.205844 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.205999 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.206143 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.206293 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.206436 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.206580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.206731 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.206876 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.207029 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.207179 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.207323 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.207473 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.207626 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.207771 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.207960 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.208117 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.208261 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.208420 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.208570 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.208714 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.208868 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.209055 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.209200 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.209351 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.209503 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.209647 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.209797 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.209947 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.210122 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.210280 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.210431 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.210575 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.210719 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.210872 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.211015 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.211166 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.211311 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.211460 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.211604 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.211748 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.211930 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.212083 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.212226 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.212368 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.212511 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.212653 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.212820 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.213049 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.213199 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.213356 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.213499 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.213642 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.213799 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.213799 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.214082 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.214226 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.214368 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.214601 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.215274 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.215419 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.215562 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.215704 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.215847 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.216041 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.216450 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.216611 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.216755 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.216898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.217041 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.217191 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.217335 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.217492 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.217636 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.217778 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.217920 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.218082 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.218227 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.218377 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.218520 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.218663 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.218805 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.218956 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.219101 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.219243 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.219402 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.219545 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.219688 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.219943 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.220097 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.220242 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.220385 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.220527 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.220683 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.220833 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.220992 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.221135 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.221278 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.221432 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.221584 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.221728 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.221878 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.222021 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.222164 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.222307 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.222471 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.222616 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.222760 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.222910 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.223146 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.223298 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.223461 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.223614 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.223758 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.223994 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.224147 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.224300 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.224445 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.224672 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.224826 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.224970 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.225113 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.225265 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.225421 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.225572 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.225726 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.225877 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.226020 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.226173 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.226318 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.226461 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.226604 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.226747 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.226889 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.227048 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.227193 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.227346 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.227497 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.227649 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.227806 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.227990 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.227990 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.228276 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.228420 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.228565 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.228565 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.228846 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.228988 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.229137 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.229137 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.229433 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.229586 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.229731 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.229873 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.230022 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.230172 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.230867 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.230867 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.231170 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.231313 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.231456 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.231599 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.231754 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.231963 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.232116 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.232266 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.232418 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.232418 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.232700 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.232845 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.232988 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.233212 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.233366 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.233517 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.233669 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.233825 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.233977 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.234121 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.234263 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.234406 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.234556 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.234785 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.234940 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.235084 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.235227 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.235370 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.235521 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.235737 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.235905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.236056 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.236199 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.236353 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.236498 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.236649 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.236792 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.236936 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.237085 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.237237 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.237394 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.237538 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.237702 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.237846 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.237998 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.238161 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.238307 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.238450 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.238600 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.238744 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.238888 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.239041 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.239185 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.239328 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.239470 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.239632 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.239785 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.239966 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.240115 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.240259 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.240402 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.240555 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.240707 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.240852 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.241018 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.241180 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.241325 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.241468 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.241630 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.241775 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.241917 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.242060 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.242203 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.242353 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.242510 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.242654 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.242797 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.242940 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.243089 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.243264 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.243478 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.243641 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.243641 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.243975 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244070 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244158 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244229 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244304 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244371 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244444 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244510 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244599 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244680 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244758 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244834 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.244976 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.245100 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.245306 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.245427 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.245619 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.245740 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.245957 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.246084 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.246275 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.246401 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.246591 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.246717 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.246918 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.247044 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.247240 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.247365 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.247583 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.247677 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.247900 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.248017 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.248212 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.248332 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.248514 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.248648 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.248815 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.248962 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.249121 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.249288 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.249421 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.249601 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.249719 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.249918 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.250028 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.250229 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.250316 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.250538 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.250623 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.250852 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.250946 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.251169 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.251254 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.251468 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.251729 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.251824 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.252087 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.252173 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.252394 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.252479 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.252701 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.252797 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.253020 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.253118 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.253326 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.253413 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.253624 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.253724 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.253923 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.254018 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.254222 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.254315 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.254559 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.254656 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.254859 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.254946 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.255188 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.255283 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.255498 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.255583 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.255813 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.255931 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.256147 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.256241 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.256447 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.256548 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.256752 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.256845 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.257057 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.257141 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.257356 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.257452 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.257656 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.257750 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.257960 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.258053 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.258263 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.258357 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.258559 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.258644 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.258864 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.258951 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.259167 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.259261 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.259471 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.259563 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.259773 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.259858 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.260099 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.260187 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.260403 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.260503 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.260703 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.260788 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.261007 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.261100 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.261309 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.261395 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.261632 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.261725 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.261932 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.262019 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.262238 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.262323 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.262545 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.262642 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.262844 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.262949 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.263151 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.263250 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.263446 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.263541 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.263755 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.263848 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.264082 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.264170 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.264384 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.264482 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.264684 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.264769 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.264988 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.265071 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.265293 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.265386 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.265592 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.265685 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.265907 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.266004 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.266216 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.266315 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.266517 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.266604 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.266904 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.267126 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.267211 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.267429 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.267520 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.267725 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.267810 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.268054 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.268144 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.268365 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.268459 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.268671 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.268756 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.268969 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.269053 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.269274 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.269359 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.269573 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.269663 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.269873 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.269967 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.270173 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.270264 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.270477 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.270575 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.270775 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.270861 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.271075 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.271160 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.271372 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.271501 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.271670 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.271756 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.271991 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.272080 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.272296 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.272397 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.272607 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.272692 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.272906 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.272992 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.273210 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.273332 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.273510 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.273609 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.273819 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.273904 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.274126 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.274213 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.274433 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.274527 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.274746 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.274839 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.275062 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.275148 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.275379 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.275464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.275685 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.275769 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.276022 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.276120 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.276333 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.276427 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.276635 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.276720 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.276940 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.277021 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278043 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278140 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278287 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278437 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278562 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278688 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278812 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278938 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.278938 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.279269 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.279402 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.279535 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.279535 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.279767 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.279914 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.280068 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.280189 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.280323 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.280457 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.280592 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.280757 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.280896 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.281061 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.281186 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.281367 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.281491 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.281670 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.281794 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.281975 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.282102 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.282282 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.282406 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.282588 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.282723 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.282895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.283019 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.283208 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.283349 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.283522 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.283637 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.283833 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.284044 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.284170 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.284304 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.284438 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.284561 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.284744 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.284880 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.285047 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.285174 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.285367 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.285506 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.285669 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.285815 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.285973 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.286178 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.286303 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.286427 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.286562 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.286687 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.286860 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.286996 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.287163 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.287287 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.287509 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.287632 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.287824 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.287989 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.288168 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.288293 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.288481 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.288606 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.288786 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.288920 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.289093 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.289232 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.289404 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.289527 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.289712 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.289835 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.290015 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.290139 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.290331 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.290474 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.290640 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.290766 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.290949 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.291084 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.291263 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.291387 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.291576 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.291711 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.291925 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.292069 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.292214 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.292338 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.292533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.292658 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.293365 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.293497 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.293690 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.293813 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.293996 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.294133 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.294299 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.294433 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.294599 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.294742 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.294919 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.295044 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.295329 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.295457 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.295636 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.295773 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.295965 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.296092 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.296278 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.296418 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.296591 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.296729 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.296909 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.297044 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.297228 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.297354 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.297540 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.297664 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.297882 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.298016 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.298189 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.298294 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.298502 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.298594 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.298808 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.298900 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.299131 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.299222 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.299454 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.299546 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.299763 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.299854 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.300100 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.300192 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.300406 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.300494 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.300713 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.300804 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.301023 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.301123 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.301333 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.301424 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.301646 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.301761 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.301974 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.302072 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.302359 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.302458 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.302666 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.302757 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.302982 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.303073 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.303303 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.303404 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.303611 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.303712 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.303955 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.304080 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.304267 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.304387 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.304569 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.304660 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.304870 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.304957 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.305190 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.305290 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.305490 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.305580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.305798 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.305890 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.306105 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.306192 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.306411 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.306503 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.306712 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.306798 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.307011 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.307097 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.307328 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.307414 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.307627 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.307713 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.307966 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.308056 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.308281 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.308380 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.308625 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.308718 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.308942 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.309063 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.309245 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.309391 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.309563 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.309705 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.309868 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.310027 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.310170 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.310354 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.310488 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.310663 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.310757 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.310970 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.311093 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.311284 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.311395 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.311591 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.311710 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.311923 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.312072 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.312245 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.312400 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.312555 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.312709 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.312869 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.313037 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.313183 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.313366 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.313496 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.313681 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.313803 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.313998 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.314105 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.314317 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.314404 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.314617 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.314702 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.314916 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.315023 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.315222 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.315339 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.315523 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.315663 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.315824 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.316008 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.316152 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.316316 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.316457 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.316639 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.316757 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.316951 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.317045 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.317258 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.317344 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.317564 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.317651 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.317869 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.317957 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.318218 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.318304 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.318524 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.318609 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.318821 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.318913 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.319122 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.319208 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.319420 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.319515 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.319756 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.319850 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.320083 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.320173 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.320414 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.320508 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.320725 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.320812 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.321043 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.321128 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.321365 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.321464 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.321671 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.321764 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.321979 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.322065 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.322289 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.322384 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.322592 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.322678 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.322901 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.322994 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.323209 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.323309 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.323520 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.323606 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.323827 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.324028 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.324199 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.324288 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.324507 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.324593 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.324833 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.324918 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.325141 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.325227 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.325455 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.325539 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.325765 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.325968 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.326100 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.326295 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.326419 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.326609 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.326702 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.326918 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.327013 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.327227 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.327313 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.327537 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.327623 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.327846 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.327952 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.328178 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.328266 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.328487 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.328573 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.328794 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.328881 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.329102 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.329189 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.329426 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.329511 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.329746 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.329833 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.330065 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.330150 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.330379 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.330472 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.330697 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.330828 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.331015 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.331109 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.331333 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.331429 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.331648 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.331741 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.331987 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.332077 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.332310 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.332407 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.332631 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.332716 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.332945 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.333154 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.333313 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.333487 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.333595 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.333806 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.333908 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.334119 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.334257 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.334437 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.334524 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.334742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.334826 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.335050 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.335144 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.335354 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.335447 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.335662 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.335748 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.335994 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.336082 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.336309 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.336403 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.336636 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.336722 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.336954 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.337040 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.337263 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.337349 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.337573 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.337659 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.337884 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.337972 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.338221 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.338399 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.338538 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.338715 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.338856 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.339045 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.339216 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.339371 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.339534 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.340229 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.340377 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.340547 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.340697 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.340862 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.341028 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.341187 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.341586 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.341753 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.341902 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.342054 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.342216 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.342362 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.342532 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.342667 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.342848 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.342966 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.343161 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.343285 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.343472 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.343593 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.343788 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.343931 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.344130 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.344218 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.344457 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.344546 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.344793 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.345027 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.345114 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.345369 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.345454 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.345682 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.345767 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.346007 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.346093 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.346329 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.346531 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.346644 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.346846 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.346943 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.347182 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.347267 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.347510 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.347596 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.347833 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.347947 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.348173 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.348266 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.348480 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.348567 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.348783 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.348877 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.349084 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.349177 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.349391 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.349483 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.349697 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.349790 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.349997 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.350083 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.350303 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.350394 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.350600 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.350692 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.350922 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.351053 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.351224 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.351309 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.351523 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.351616 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.351823 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.351956 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.352154 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.352389 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.352478 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.352740 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.352832 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.353040 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.353134 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.353340 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.353433 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.353644 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.353730 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.353948 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.354033 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.354251 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.354338 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.354549 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.354634 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.354853 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.354946 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.355150 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.355237 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.356021 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.356161 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.356366 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.356500 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.356673 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.356765 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.356972 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.357057 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.357273 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.357367 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.357582 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.357669 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.357885 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.357970 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.358196 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.358291 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.358501 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.358587 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.358807 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.358900 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.359123 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.359217 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.359431 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.359530 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.359740 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.359979 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.360081 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.360308 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.360394 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.360623 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.360711 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.360950 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.361045 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.361255 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.361339 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.361565 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.361661 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.361867 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.361962 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.362165 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.362250 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.362468 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.362551 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.362776 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.362862 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.363079 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.363163 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.363383 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.363468 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.363690 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.363776 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.364027 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.364114 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.364335 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.364422 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.364639 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.364728 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.364944 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.365029 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.365247 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.365332 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.365550 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.365644 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.365854 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.365947 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.366156 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.366254 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.366460 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.366581 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.366768 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.366855 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.367108 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.367320 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.367407 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.367654 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.367740 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.368007 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.368098 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.368345 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.368432 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.368649 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.368733 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.368954 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.369046 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.369260 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.369353 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.369563 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.369686 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.369875 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.369970 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.370187 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.370279 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.370497 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.370583 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.370797 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.370963 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.371134 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.371220 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.371446 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.371533 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.371757 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.371856 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.372095 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.372193 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.372409 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.372503 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.372721 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.372807 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.373032 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.373126 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.373344 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.373430 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.373655 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.373741 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.373965 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.374049 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.374277 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.374363 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.374608 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.374694 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.374932 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.375023 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.375247 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.375340 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.375549 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.375634 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.375850 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.375995 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.376173 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.376272 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.376479 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.376566 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.376792 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.376886 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.377093 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.377186 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.377393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.377480 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.377691 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.377776 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.377996 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.378082 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.378293 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.378378 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.378590 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.378725 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.378887 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.379041 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.379185 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.379362 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.379488 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.379685 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.379785 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.380023 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.380112 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.380347 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.380433 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.380669 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.380765 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.380969 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.381062 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.381268 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.381353 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.381572 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.381660 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.381871 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.381956 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.382169 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.382255 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.382466 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.382553 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.382763 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.382855 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.383061 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.383146 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.383387 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.383474 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.383714 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.383800 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.384048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.384149 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.384371 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.384465 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.384682 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.384776 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.384987 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.385081 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.385291 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.385378 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.385603 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.385690 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.385909 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.386004 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.386214 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.386300 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.386535 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.386618 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.386843 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.386941 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.387154 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.387250 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.387458 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.387545 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.387763 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.387849 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.388088 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.388184 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.388392 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.388477 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.388699 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.388792 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.389003 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.389088 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.389315 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.389400 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.389617 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.389702 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.389920 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.390004 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.390225 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.390351 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.390529 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.390616 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.390834 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.390919 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.391139 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.391236 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.391465 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.391550 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.391772 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.391889 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.392106 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.392203 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.392417 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.392502 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.392723 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.392808 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.393029 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.393126 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.393341 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.393426 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.393651 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.393743 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.393963 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.394049 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.394276 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.394361 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.394580 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.394664 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.394902 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.394988 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.395212 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.395305 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.395523 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.395609 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.395834 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.395938 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.396167 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.396254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.396478 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.396564 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.396804 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.396936 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.397112 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.397198 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.397415 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.397509 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.397655 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 11:47:22.397741 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.398044 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.398366 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.398691 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.399005 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.399338 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.399652 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.400001 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.400321 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.400634 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.400949 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.401268 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.401583 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.401915 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.402754 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.403067 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.403396 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.403726 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.404104 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.404421 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.404766 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.405098 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.405415 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.405732 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.406041 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:47:22.406286 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 11:47:22.458954 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO dbcounter [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Registered counter for database nova_api Jun 16 11:47:22.468256 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO dbcounter [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Registered counter for database nova_api Jun 16 11:47:22.479823 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_db.sqlalchemy.engines [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:47:22.488817 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writer thread running {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:47:22.489927 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:47:22.496525 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writer thread running {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:47:22.544862 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.context [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0(cell1) {{(pid=110283) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 11:47:22.548953 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:47:22.550514 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:47:22.551322 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:47:22.553310 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:47:22.553591 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.context [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0(cell1) {{(pid=110282) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 11:47:22.555253 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO dbcounter [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Registered counter for database nova_cell0 Jun 16 11:47:22.557690 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG oslo_concurrency.lockutils [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:47:22.559156 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO dbcounter [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Registered counter for database nova_cell1 Jun 16 11:47:22.559297 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG oslo_concurrency.lockutils [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:47:22.560145 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG oslo_concurrency.lockutils [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:47:22.562129 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG oslo_concurrency.lockutils [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:47:22.564132 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO dbcounter [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Registered counter for database nova_cell0 Jun 16 11:47:22.566633 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_db.sqlalchemy.engines [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:47:22.568105 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO dbcounter [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Registered counter for database nova_cell1 Jun 16 11:47:22.568336 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_db.sqlalchemy.engines [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:47:22.573928 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writer thread running {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:47:22.575735 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:47:22.577634 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:47:22.585252 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writer thread running {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:47:22.585594 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writer thread running {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:47:22.712603 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writer thread running {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:47:22.723268 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO dbcounter [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Registered counter for database nova_cell0 Jun 16 11:47:22.731333 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_db.sqlalchemy.engines [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:47:22.733740 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO dbcounter [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Registered counter for database nova_cell0 Jun 16 11:47:22.735772 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writer thread running {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:47:22.742267 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:47:22.746577 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writer thread running {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:47:23.156542 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: WARNING keystonemiddleware.auth_token [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 11:47:23.163774 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: WARNING keystonemiddleware.auth_token [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 11:47:23.186333 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: WARNING keystonemiddleware.auth_token [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 11:47:23.193498 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: WARNING keystonemiddleware.auth_token [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 11:47:23.506225 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: WARNING keystonemiddleware.auth_token [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 11:47:23.512214 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: WARNING keystonemiddleware.auth_token [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 11:47:23.517501 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a1fbd89c0 pid: 110283 (default app) Jun 16 11:47:23.519565 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:47:23.520792 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 Jun 16 11:47:23.521197 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Thu Jun 16 11:47:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:47:23.532474 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: WARNING keystonemiddleware.auth_token [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 11:47:23.538351 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: WARNING keystonemiddleware.auth_token [None req-b4c799bf-800f-44b8-b39f-3f1fbe4fcb9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 11:47:23.544179 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a1fbd89c0 pid: 110282 (default app) Jun 16 11:48:41.780828 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:41.782525 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jun 16 11:48:41.783199 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:48:41.795568 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writing DB stats nova_api:SELECT=3 {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:41.796527 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writing DB stats nova_cell0:SELECT=3 {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:41.797526 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writing DB stats nova_cell1:SELECT=3 {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:41.798551 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:42.229118 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-f88576ef-0194-4233-bba6-7df3ceb66aee admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:42.258531 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-f88576ef-0194-4233-bba6-7df3ceb66aee admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.468814 Jun 16 11:48:42.263921 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jun 16 11:48:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:48:44.428738 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:44.429698 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-124f017e-3081-4ce3-9384-6a02d6fe4bad None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Jun 16 11:48:44.430554 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:48:44.496602 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-200e3c0b-707c-4368-9a9b-9fa189206d40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:44.514984 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:48:44.514984 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: warnings.warn(msg) Jun 16 11:48:44.596240 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-200e3c0b-707c-4368-9a9b-9fa189206d40 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.159088 Jun 16 11:48:44.596812 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:48:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:48:44.611746 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_api:SELECT=3 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:44.613131 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_cell0:SELECT=3 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:44.614419 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_cell1:SELECT=3 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:44.615691 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:44.826261 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-8813cc11-49b5-49d0-967c-4672af161a05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:44.828731 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:48:44.828731 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: warnings.warn(msg) Jun 16 11:48:44.931502 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-8813cc11-49b5-49d0-967c-4672af161a05 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.325673 Jun 16 11:48:44.932115 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 11:48:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:48:47.086594 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-200e3c0b-707c-4368-9a9b-9fa189206d40 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:47.087614 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-200e3c0b-707c-4368-9a9b-9fa189206d40 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 16 11:48:47.088704 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:48:47.228848 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-6a6e7ef6-15be-4e26-b58f-591a9eb50808 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "id": "d1", "rxtx_factor": 1.0}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:47.247337 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:48:47.247337 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: warnings.warn(msg) Jun 16 11:48:47.313303 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-6a6e7ef6-15be-4e26-b58f-591a9eb50808 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.218077 Jun 16 11:48:47.313807 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:48:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:48:47.325893 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-dab6bf50-2496-4553-8d34-301137ebc9b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:47.327421 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:48:47.327421 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: warnings.warn(msg) Jun 16 11:48:47.412023 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-dab6bf50-2496-4553-8d34-301137ebc9b2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089836 Jun 16 11:48:47.412589 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 11:48:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:48:49.625326 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-6a6e7ef6-15be-4e26-b58f-591a9eb50808 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:49.626344 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-6a6e7ef6-15be-4e26-b58f-591a9eb50808 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 16 11:48:49.626744 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:48:49.690031 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-1d7e584b-f038-413f-b0d6-e5f61dfa4f84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:49.764921 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-1d7e584b-f038-413f-b0d6-e5f61dfa4f84 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132171 Jun 16 11:48:49.765732 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:48:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 11:48:49.777399 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-41fe71a9-f587-40d9-bb4c-592195c872bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:49.843584 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-41fe71a9-f587-40d9-bb4c-592195c872bd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069805 Jun 16 11:48:49.844197 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 11:48:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:48:52.018544 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-1d7e584b-f038-413f-b0d6-e5f61dfa4f84 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:52.019551 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-1d7e584b-f038-413f-b0d6-e5f61dfa4f84 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 16 11:48:52.020054 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:48:52.077566 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-e764fb58-82c8-4430-9d03-642bc8f3439c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "swap": 0}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:52.140967 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-e764fb58-82c8-4430-9d03-642bc8f3439c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.114481 Jun 16 11:48:52.141553 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:48:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 11:48:52.154575 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-1cfbb107-b662-4fb1-9696-5608572b2299 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:52.270652 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-1cfbb107-b662-4fb1-9696-5608572b2299 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119939 Jun 16 11:48:52.271280 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 11:48:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:48:54.434584 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-e764fb58-82c8-4430-9d03-642bc8f3439c admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:54.435973 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-e764fb58-82c8-4430-9d03-642bc8f3439c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Jun 16 11:48:54.436491 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:48:54.497784 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-dfd92b04-d6c6-4d89-b655-996bcc3306f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "id": "d4"}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:54.563506 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-dfd92b04-d6c6-4d89-b655-996bcc3306f3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.121276 Jun 16 11:48:54.564152 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:48:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:48:54.577816 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-1839d657-3121-434c-96dc-08950d249934 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:54.653394 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-1839d657-3121-434c-96dc-08950d249934 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080385 Jun 16 11:48:54.654064 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 11:48:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:48:56.812991 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-dfd92b04-d6c6-4d89-b655-996bcc3306f3 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:56.813996 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-dfd92b04-d6c6-4d89-b655-996bcc3306f3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 16 11:48:56.814404 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:48:56.875036 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-f3f76b09-387c-4752-bd17-d45ab5970e40 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:56.899590 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-f3f76b09-387c-4752-bd17-d45ab5970e40 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079249 Jun 16 11:48:56.900162 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jun 16 11:48:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:48:59.264000 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-dfd92b04-d6c6-4d89-b655-996bcc3306f3 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:48:59.265025 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-dfd92b04-d6c6-4d89-b655-996bcc3306f3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 16 11:48:59.265446 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:48:59.323142 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-b5a1f304-744b-49e3-a9b6-a6071d33a7e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:59.386793 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-b5a1f304-744b-49e3-a9b6-a6071d33a7e3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.115577 Jun 16 11:48:59.387347 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:48:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:48:59.399246 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-3729db11-a429-410c-87de-c85322d776b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:48:59.470224 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-3729db11-a429-410c-87de-c85322d776b6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074497 Jun 16 11:48:59.475573 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 11:48:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:49:02.266624 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-b5a1f304-744b-49e3-a9b6-a6071d33a7e3 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:02.267675 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-b5a1f304-744b-49e3-a9b6-a6071d33a7e3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 16 11:49:02.268154 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:02.327335 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-b7e1ba7b-8bf7-4217-bd8c-8c8289a2e458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:02.403635 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-b7e1ba7b-8bf7-4217-bd8c-8c8289a2e458 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.129565 Jun 16 11:49:02.404232 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:49:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:49:02.420199 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-95295131-19cf-495b-8e1b-55c0228e7623 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:02.504311 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-95295131-19cf-495b-8e1b-55c0228e7623 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089241 Jun 16 11:49:02.504904 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 11:49:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:49:04.674906 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-b7e1ba7b-8bf7-4217-bd8c-8c8289a2e458 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:04.675961 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-b7e1ba7b-8bf7-4217-bd8c-8c8289a2e458 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 16 11:49:04.676517 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:49:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:49:04.734530 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-b225aa02-23de-4521-ad90-4abaf5369b6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "ram": 4096, "id": "3", "os-flavor-access:is_public": true}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:04.820865 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-b225aa02-23de-4521-ad90-4abaf5369b6d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.137630 Jun 16 11:49:04.821608 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:49:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:49:04.833402 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-ac530b9b-3b1e-40d6-9fc3-7e3d95271bdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:04.922023 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-ac530b9b-3b1e-40d6-9fc3-7e3d95271bdd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092343 Jun 16 11:49:04.922534 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 11:49:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:49:07.109154 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-b225aa02-23de-4521-ad90-4abaf5369b6d admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:07.110159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-b225aa02-23de-4521-ad90-4abaf5369b6d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 16 11:49:07.110555 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:49:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:07.176652 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-df0a3e88-0c0a-4885-92bb-ac416d9068d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:07.271649 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-df0a3e88-0c0a-4885-92bb-ac416d9068d7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.154961 Jun 16 11:49:07.272018 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:49:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 11:49:07.284421 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-88204227-7d1c-44af-a91f-8329d8cb1e45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:07.372737 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-88204227-7d1c-44af-a91f-8329d8cb1e45 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091917 Jun 16 11:49:07.373404 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 11:49:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:49:09.539844 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-df0a3e88-0c0a-4885-92bb-ac416d9068d7 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:09.541458 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-df0a3e88-0c0a-4885-92bb-ac416d9068d7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Jun 16 11:49:09.542048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:09.607849 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-9ec3baf8-85bc-4f52-b307-b26410260f11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:10.245463 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-9ec3baf8-85bc-4f52-b307-b26410260f11 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.695941 Jun 16 11:49:10.246106 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 11:49:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:49:10.262471 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-7551ad61-a042-4838-a5d6-eb98d1f9ece7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:10.425549 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-7551ad61-a042-4838-a5d6-eb98d1f9ece7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.170600 Jun 16 11:49:10.426569 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 11:49:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:49:34.192439 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-9ec3baf8-85bc-4f52-b307-b26410260f11 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:34.193449 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-9ec3baf8-85bc-4f52-b307-b26410260f11 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 16 11:49:34.193840 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:34.204148 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:49:34.252625 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-78040413-b325-484f-9e29-acae4a795b16 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:34.269160 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-78040413-b325-484f-9e29-acae4a795b16 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069602 Jun 16 11:49:34.269847 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jun 16 11:49:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:49:35.221460 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-9ec3baf8-85bc-4f52-b307-b26410260f11 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:35.222450 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-9ec3baf8-85bc-4f52-b307-b26410260f11 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Jun 16 11:49:35.222836 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:49:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:35.421716 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-fdf9c91b-2fb9-43c4-b29e-e91bef1e1640 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:35.427185 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.wsgi [None req-fdf9c91b-2fb9-43c4-b29e-e91bef1e1640 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-fdf9c91b-2fb9-43c4-b29e-e91bef1e1640 admin admin] Request method failure captured: Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Accept: application/json Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Accept-Encoding: gzip, deflate Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Connection: keep-alive Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Content-Length: 0 Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Host: 10.222.0.40 Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Openstack-Api-Version: compute 2.90 Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Openstack-System-Scope: None Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: User-Agent: python-novaclient Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Auth-Token: gAAAAABiqxjPcQQkZuinPBPXeZW5aDYAR4hUZ7jssnxg5AxchGrnihJfYM6J0EUvAPLzAcXwEnTqUbHXYdgXWZJrW5DsZj-44uZWkEL-2sglTUERg3z0l6-LI6F8VNbw3tnUm2dQ5TeL93w0JE9H7AfpfQ_qmME_qixtVLYXbemqbTRpDVXMeWk Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Domain-Id: None Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Domain-Name: None Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Identity-Status: Confirmed Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Is-Admin-Project: True Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Domain-Id: default Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Domain-Name: Default Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Name: admin Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Role: member,reader,admin Jun 16 11:49:35.430443 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Roles: member,reader,admin Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c9c201c143164f7b8064c986ec08f397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant: admin Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant-Name: admin Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User: admin Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Domain-Id: default Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Domain-Name: Default Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Id: 1361568ee63a477ea9c9be31d039c80d Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Name: admin Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: method: > Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: exception: Flavor 42 could not be found. Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: action_args: {'id': '42'} Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:49:35.431905 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:35.432791 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.434308 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-fdf9c91b-2fb9-43c4-b29e-e91bef1e1640 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:49:35.435624 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-fdf9c91b-2fb9-43c4-b29e-e91bef1e1640 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061646 Jun 16 11:49:35.435624 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jun 16 11:49:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 11:49:35.441434 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-46ad3ca2-4be5-41df-950a-ad6fa7e04baf admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:35.444950 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:49:35.463745 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-46ad3ca2-4be5-41df-950a-ad6fa7e04baf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025837 Jun 16 11:49:35.464296 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 11:49:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:49:35.474253 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-c7a2a0a4-0adf-483d-a363-32ffd92cdf1a admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:35.495661 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-c7a2a0a4-0adf-483d-a363-32ffd92cdf1a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025042 Jun 16 11:49:35.496234 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 11:49:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:49:35.505732 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-16940645-3a79-4500-9654-7d979a21f93a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:35.512153 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.wsgi [None req-16940645-3a79-4500-9654-7d979a21f93a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-16940645-3a79-4500-9654-7d979a21f93a admin admin] Request method failure captured: Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Accept: application/json Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Accept-Encoding: gzip, deflate Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Connection: keep-alive Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Content-Length: 0 Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Host: 10.222.0.40 Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Openstack-Api-Version: compute 2.90 Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Openstack-System-Scope: None Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: User-Agent: python-novaclient Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Auth-Token: gAAAAABiqxjPcQQkZuinPBPXeZW5aDYAR4hUZ7jssnxg5AxchGrnihJfYM6J0EUvAPLzAcXwEnTqUbHXYdgXWZJrW5DsZj-44uZWkEL-2sglTUERg3z0l6-LI6F8VNbw3tnUm2dQ5TeL93w0JE9H7AfpfQ_qmME_qixtVLYXbemqbTRpDVXMeWk Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Domain-Id: None Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Domain-Name: None Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Identity-Status: Confirmed Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Is-Admin-Project: True Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Domain-Id: default Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Domain-Name: Default Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Name: admin Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Role: member,reader,admin Jun 16 11:49:35.515393 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Roles: member,reader,admin Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c9c201c143164f7b8064c986ec08f397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant: admin Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant-Name: admin Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User: admin Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Domain-Id: default Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Domain-Name: Default Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Id: 1361568ee63a477ea9c9be31d039c80d Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Name: admin Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: method: > Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: exception: Flavor 42 could not be found. Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: action_args: {'id': '42'} Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:49:35.523095 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:35.523929 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:35.525159 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-16940645-3a79-4500-9654-7d979a21f93a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:49:35.526175 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-16940645-3a79-4500-9654-7d979a21f93a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014948 Jun 16 11:49:35.526175 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jun 16 11:49:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:36.388363 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-c7a2a0a4-0adf-483d-a363-32ffd92cdf1a admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:36.389390 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-c7a2a0a4-0adf-483d-a363-32ffd92cdf1a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 16 11:49:36.389784 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:36.579810 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-74ad69c3-04a1-4d09-afbc-9d0331a5c580 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:36.585749 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.wsgi [None req-74ad69c3-04a1-4d09-afbc-9d0331a5c580 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-74ad69c3-04a1-4d09-afbc-9d0331a5c580 admin admin] Request method failure captured: Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Accept: application/json Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Accept-Encoding: gzip, deflate Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Connection: keep-alive Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Content-Length: 0 Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Host: 10.222.0.40 Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Openstack-Api-Version: compute 2.90 Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Openstack-System-Scope: None Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: User-Agent: python-novaclient Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Auth-Token: gAAAAABiqxjQVlFdQTxAV6K3tSCGqBXjAvwQs8WY_MQIyeEzv2L765E0AtqkTIXqhFEHUtr8ywc5rSRU9LXVnTnZeqSNu-uD6yXLvYJc1g5RlbVXc4hlNCf5EMIf956mm0Ysroop4OmInmgC78j9j8CzARXEudKXSXfsICV1wffhWms71ZA3EyY Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Domain-Id: None Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Domain-Name: None Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Identity-Status: Confirmed Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Is-Admin-Project: True Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Domain-Id: default Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Domain-Name: Default Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Name: admin Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Role: member,reader,admin Jun 16 11:49:36.587254 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Roles: member,reader,admin Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c9c201c143164f7b8064c986ec08f397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant: admin Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant-Name: admin Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User: admin Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Domain-Id: default Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Domain-Name: Default Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Id: 1361568ee63a477ea9c9be31d039c80d Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Name: admin Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: method: > Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: exception: Flavor 84 could not be found. Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: action_args: {'id': '84'} Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:49:36.588742 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:36.589693 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.591076 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-74ad69c3-04a1-4d09-afbc-9d0331a5c580 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:49:36.595316 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-74ad69c3-04a1-4d09-afbc-9d0331a5c580 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060217 Jun 16 11:49:36.595316 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jun 16 11:49:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:36.598582 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-4379eaad-bc6a-4e90-90d3-d9994af9a680 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:36.614218 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-4379eaad-bc6a-4e90-90d3-d9994af9a680 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019242 Jun 16 11:49:36.614731 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 11:49:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:49:36.624168 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-ef26c0f5-219f-4afe-829e-9fefdc5f8f2a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:36.638069 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-ef26c0f5-219f-4afe-829e-9fefdc5f8f2a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017377 Jun 16 11:49:36.638583 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 11:49:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:49:36.648086 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-0b0d543c-fa8a-47a7-89e9-8ab3e31c5af5 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:36.653532 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.wsgi [None req-0b0d543c-fa8a-47a7-89e9-8ab3e31c5af5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-0b0d543c-fa8a-47a7-89e9-8ab3e31c5af5 admin admin] Request method failure captured: Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Accept: application/json Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Accept-Encoding: gzip, deflate Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Connection: keep-alive Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Content-Length: 0 Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Host: 10.222.0.40 Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Openstack-Api-Version: compute 2.90 Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Openstack-System-Scope: None Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: User-Agent: python-novaclient Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Auth-Token: gAAAAABiqxjQVlFdQTxAV6K3tSCGqBXjAvwQs8WY_MQIyeEzv2L765E0AtqkTIXqhFEHUtr8ywc5rSRU9LXVnTnZeqSNu-uD6yXLvYJc1g5RlbVXc4hlNCf5EMIf956mm0Ysroop4OmInmgC78j9j8CzARXEudKXSXfsICV1wffhWms71ZA3EyY Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Domain-Id: None Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Domain-Name: None Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Identity-Status: Confirmed Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Is-Admin-Project: True Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Domain-Id: default Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Domain-Name: Default Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Name: admin Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Role: member,reader,admin Jun 16 11:49:36.655039 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Roles: member,reader,admin Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c9c201c143164f7b8064c986ec08f397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant: admin Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant-Name: admin Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User: admin Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Domain-Id: default Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Domain-Name: Default Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Id: 1361568ee63a477ea9c9be31d039c80d Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Name: admin Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: method: > Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: exception: Flavor 84 could not be found. Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: action_args: {'id': '84'} Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:49:36.656580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:36.657453 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:36.658580 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-0b0d543c-fa8a-47a7-89e9-8ab3e31c5af5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:49:36.659625 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-0b0d543c-fa8a-47a7-89e9-8ab3e31c5af5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012479 Jun 16 11:49:36.659625 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jun 16 11:49:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 11:49:37.514218 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-ef26c0f5-219f-4afe-829e-9fefdc5f8f2a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:37.515226 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-ef26c0f5-219f-4afe-829e-9fefdc5f8f2a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 11:49:37.515614 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:37.705569 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-0db88c9c-5867-4fc5-90dc-76c1bd1c726f admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:37.711007 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.wsgi [None req-0db88c9c-5867-4fc5-90dc-76c1bd1c726f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-0db88c9c-5867-4fc5-90dc-76c1bd1c726f admin admin] Request method failure captured: Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Accept: application/json Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Accept-Encoding: gzip, deflate Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Connection: keep-alive Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Content-Length: 0 Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Host: 10.222.0.40 Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Openstack-Api-Version: compute 2.90 Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Openstack-System-Scope: None Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: User-Agent: python-novaclient Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Auth-Token: gAAAAABiqxjRdImUlNBc9l0hxkP4i62dwGxfmjGPudVNDWL6T26-xdWbYejFxJmcQswLo_lU2XOKiWiIN2uykZaQUS4wjZSvBSJvDBKpg1UJZL3Xy5JfpQMxb2l0W-QWRCuB3LOdZvwIBtekxtpU8nSG-7dwfklWN070dPWqW60AuE27OzJLhjw Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Domain-Id: None Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Domain-Name: None Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Identity-Status: Confirmed Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Is-Admin-Project: True Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Domain-Id: default Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Domain-Name: Default Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Project-Name: admin Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Role: member,reader,admin Jun 16 11:49:37.712533 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Roles: member,reader,admin Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c9c201c143164f7b8064c986ec08f397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant: admin Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-Tenant-Name: admin Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User: admin Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Domain-Id: default Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Domain-Name: Default Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Id: 1361568ee63a477ea9c9be31d039c80d Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: X-User-Name: admin Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: method: > Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: exception: Flavor 451 could not be found. Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: action_args: {'id': '451'} Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:49:37.714074 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:37.714958 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.716048 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-0db88c9c-5867-4fc5-90dc-76c1bd1c726f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:49:37.717046 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-0db88c9c-5867-4fc5-90dc-76c1bd1c726f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060833 Jun 16 11:49:37.717046 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 11:49:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 11:49:37.723861 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-e0f14702-84b5-4b49-bab5-a05d2a88b9c3 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:37.739688 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-e0f14702-84b5-4b49-bab5-a05d2a88b9c3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019269 Jun 16 11:49:37.740191 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 11:49:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:49:37.750366 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:37.763383 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016888 Jun 16 11:49:37.763938 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 11:49:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:49:37.773178 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-4ef121be-cab1-4466-a63e-08f67b63c2d3 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:37.778456 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.wsgi [None req-4ef121be-cab1-4466-a63e-08f67b63c2d3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-4ef121be-cab1-4466-a63e-08f67b63c2d3 admin admin] Request method failure captured: Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Accept: application/json Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Accept-Encoding: gzip, deflate Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Connection: keep-alive Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Content-Length: 0 Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Host: 10.222.0.40 Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Openstack-Api-Version: compute 2.90 Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Openstack-System-Scope: None Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: User-Agent: python-novaclient Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Auth-Token: gAAAAABiqxjRdImUlNBc9l0hxkP4i62dwGxfmjGPudVNDWL6T26-xdWbYejFxJmcQswLo_lU2XOKiWiIN2uykZaQUS4wjZSvBSJvDBKpg1UJZL3Xy5JfpQMxb2l0W-QWRCuB3LOdZvwIBtekxtpU8nSG-7dwfklWN070dPWqW60AuE27OzJLhjw Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Domain-Id: None Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Domain-Name: None Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Identity-Status: Confirmed Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Is-Admin-Project: True Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Domain-Id: default Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Domain-Name: Default Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Project-Name: admin Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Role: member,reader,admin Jun 16 11:49:37.779898 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Roles: member,reader,admin Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c9c201c143164f7b8064c986ec08f397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c9c201c143164f7b8064c986ec08f397"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant: admin Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant-Id: c9c201c143164f7b8064c986ec08f397 Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-Tenant-Name: admin Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User: admin Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Domain-Id: default Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Domain-Name: Default Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Id: 1361568ee63a477ea9c9be31d039c80d Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: X-User-Name: admin Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: method: > Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: exception: Flavor 451 could not be found. Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: action_args: {'id': '451'} Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:49:37.781464 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:37.782587 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 11:49:37.783895 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-4ef121be-cab1-4466-a63e-08f67b63c2d3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:49:37.785210 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-4ef121be-cab1-4466-a63e-08f67b63c2d3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011663 Jun 16 11:49:37.785210 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 11:49:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 11:49:38.632195 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:38.633196 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 16 11:49:38.633592 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:38.824083 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-d908aa57-3e27-4eee-8b4e-a8439ae3b573 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:38.923173 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-d908aa57-3e27-4eee-8b4e-a8439ae3b573 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.151688 Jun 16 11:49:38.923665 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jun 16 11:49:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:49:39.793755 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:39.794808 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 16 11:49:39.795159 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:39.984040 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-657d2558-8441-402d-b5f7-d8ba14f55f95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:40.104300 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-657d2558-8441-402d-b5f7-d8ba14f55f95 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.170676 Jun 16 11:49:40.104771 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jun 16 11:49:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:49:40.968064 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:40.969064 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001828 Jun 16 11:49:40.969464 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:49:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:41.159401 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-5f15cd12-2d8b-4c87-939f-5b9428e1f354 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:41.213111 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-5f15cd12-2d8b-4c87-939f-5b9428e1f354 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.104491 Jun 16 11:49:41.213574 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jun 16 11:49:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 11:49:42.067710 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:42.068918 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Jun 16 11:49:42.069324 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:49:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:42.260239 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-c8389cf0-04bb-42f1-aefd-c33fe1e20230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:49:42.366596 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-c8389cf0-04bb-42f1-aefd-c33fe1e20230 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.157741 Jun 16 11:49:42.367074 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jun 16 11:49:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:49:43.238011 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:43.239009 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 16 11:49:43.239404 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:49:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:49:43.428499 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-f86e9f66-5bf9-4c9c-b089-ace56313a2e2 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:49:43.450116 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-f86e9f66-5bf9-4c9c-b089-ace56313a2e2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072928 Jun 16 11:49:43.450652 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Thu Jun 16 11:49:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:50:30.865294 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:50:30.866294 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-11ef3c4a-db8b-44b1-bd8d-82566f7435f7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 16 11:50:30.866687 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 11:50:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:50:30.877031 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:50:30.924399 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-5e565174-0c39-49bc-9d86-6af58368da29 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:50:30.944300 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-5e565174-0c39-49bc-9d86-6af58368da29 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071585 Jun 16 11:50:30.944766 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jun 16 11:50:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:50:30.966853 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-66784eca-1ed2-464f-8cc4-a4c8273cb656 admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:50:30.970528 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG dbcounter [-] [110282] Writing DB stats nova_api:SELECT=14 {{(pid=110282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:50:30.975362 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-66784eca-1ed2-464f-8cc4-a4c8273cb656 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012068 Jun 16 11:50:30.975873 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jun 16 11:50:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:50:30.987048 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-0e1c9d68-e00d-448b-8fcc-b321c4856530 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:50:30.995240 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-0e1c9d68-e00d-448b-8fcc-b321c4856530 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012020 Jun 16 11:50:30.995755 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jun 16 11:50:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:50:31.008164 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:50:31.015435 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011759 Jun 16 11:50:31.015971 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jun 16 11:50:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:50:31.026860 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-4a31a788-90b6-4521-ada4-6941decbe4db admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:50:31.034403 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-4a31a788-90b6-4521-ada4-6941decbe4db admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010968 Jun 16 11:50:31.034947 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jun 16 11:50:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:53:59.601490 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:53:59.602494 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 16 11:53:59.602906 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:53:59.759405 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_api:SELECT=6 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:53:59.874569 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-86745373-18ff-4a91-b22a-423ed261ba52 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:53:59.875792 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:53:59.875792 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: warnings.warn(msg) Jun 16 11:53:59.877081 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-86745373-18ff-4a91-b22a-423ed261ba52 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:53:59.878080 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-86745373-18ff-4a91-b22a-423ed261ba52 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:53:59.878887 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-86745373-18ff-4a91-b22a-423ed261ba52 admin admin] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:53:59.879312 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-86745373-18ff-4a91-b22a-423ed261ba52 admin admin] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:53:59.912018 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-86745373-18ff-4a91-b22a-423ed261ba52 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154022 Jun 16 11:53:59.912602 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 11:53:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:54:00.780444 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:54:00.781456 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 16 11:54:00.781848 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:54:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:54:00.976668 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-97eff586-9498-4ba3-9939-ae290ecf0c2e admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:54:00.977843 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:54:00.977843 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: warnings.warn(msg) Jun 16 11:54:00.979025 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-97eff586-9498-4ba3-9939-ae290ecf0c2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:54:00.979468 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-97eff586-9498-4ba3-9939-ae290ecf0c2e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:54:00.980317 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-97eff586-9498-4ba3-9939-ae290ecf0c2e admin admin] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:54:00.980748 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-97eff586-9498-4ba3-9939-ae290ecf0c2e admin admin] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:54:01.000431 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-97eff586-9498-4ba3-9939-ae290ecf0c2e admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076750 Jun 16 11:54:01.000971 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 11:54:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:54:12.285617 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:54:12.286641 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 16 11:54:12.287026 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:54:12.432918 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_cell0:SELECT=4 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:54:12.433993 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_cell1:SELECT=4 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:54:12.434599 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_api:SELECT=8 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:54:12.482671 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-0e196a24-d4b0-4e8f-a56e-383f23aa71e2 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:54:12.483836 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:54:12.483836 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: warnings.warn(msg) Jun 16 11:54:12.490554 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-0e196a24-d4b0-4e8f-a56e-383f23aa71e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:54:12.490554 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-0e196a24-d4b0-4e8f-a56e-383f23aa71e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:54:12.490554 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-0e196a24-d4b0-4e8f-a56e-383f23aa71e2 admin admin] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:54:12.490554 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-0e196a24-d4b0-4e8f-a56e-383f23aa71e2 admin admin] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:54:12.511028 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-0e196a24-d4b0-4e8f-a56e-383f23aa71e2 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082534 Jun 16 11:54:12.511581 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 11:54:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:54:13.391162 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: DEBUG nova.api.openstack.wsgi [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] Calling method '>' {{(pid=110282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:54:13.392318 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: INFO nova.api.openstack.requestlog [None req-b0865a4d-4429-4010-aac6-516c8ba2c9fe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 16 11:54:13.392724 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: [pid: 110282|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 11:54:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:54:13.586993 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-d787bb60-b328-4a5c-9ff2-ff6ed838f851 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:54:13.588332 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:54:13.588332 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: warnings.warn(msg) Jun 16 11:54:13.589530 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-d787bb60-b328-4a5c-9ff2-ff6ed838f851 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:54:13.589966 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-d787bb60-b328-4a5c-9ff2-ff6ed838f851 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:54:13.590762 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-d787bb60-b328-4a5c-9ff2-ff6ed838f851 admin admin] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:54:13.591185 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-d787bb60-b328-4a5c-9ff2-ff6ed838f851 admin admin] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:54:13.614153 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-d787bb60-b328-4a5c-9ff2-ff6ed838f851 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082279 Jun 16 11:54:13.614672 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 11:54:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:55:09.206354 dv-cinder-846146-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 11:55:09.207229 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: Thu Jun 16 11:55:09 2022 - graceful shutdown triggered... Jun 16 11:55:09.207735 dv-cinder-846146-2-iscsi devstack@n-api.service[110282]: Gracefully killing worker 1 (pid: 110282)... Jun 16 11:55:09.208146 dv-cinder-846146-2-iscsi devstack@n-api.service[110283]: Gracefully killing worker 2 (pid: 110283)... Jun 16 11:55:10.207979 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: worker 1 buried after 1 seconds Jun 16 11:55:10.207979 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: worker 2 buried after 1 seconds Jun 16 11:55:10.208642 dv-cinder-846146-2-iscsi devstack@n-api.service[110281]: goodbye to uWSGI. Jun 16 11:55:10.209539 dv-cinder-846146-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 11:55:10.210090 dv-cinder-846146-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 11:55:10.212834 dv-cinder-846146-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 11:55:10.227259 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 11:55:10 2022] *** Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: nodename: dv-cinder-846146-2-iscsi Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: machine: x86_64 Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: clock source: unix Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: pcre jit disabled Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: detected number of CPU cores: 4 Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: current working directory: / Jun 16 11:55:10.229367 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: detected binary path: /usr/bin/uwsgi-core Jun 16 11:55:10.230116 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: your processes number limit is 47680 Jun 16 11:55:10.230116 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: your memory page size is 4096 bytes Jun 16 11:55:10.230116 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: detected max file descriptor number: 2048 Jun 16 11:55:10.230116 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: lock engine: pthread robust mutexes Jun 16 11:55:10.230116 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: thunder lock: enabled Jun 16 11:55:10.230116 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 11:55:10.230116 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 11:55:10.274161 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: Python main interpreter initialized at 0x5625f46a09c0 Jun 16 11:55:10.274161 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: python threads support enabled Jun 16 11:55:10.274161 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: your server socket listen backlog is limited to 100 connections Jun 16 11:55:10.274161 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: your mercy for graceful operations on workers is 90 seconds Jun 16 11:55:10.274582 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 11:55:10.274678 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: *** Operational MODE: preforking *** Jun 16 11:55:10.274880 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: *** uWSGI is running in multiple interpreter mode *** Jun 16 11:55:10.274880 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: spawned uWSGI master process (pid: 125052) Jun 16 11:55:10.275094 dv-cinder-846146-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 11:55:10.275715 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: spawned uWSGI worker 1 (pid: 125054, cores: 1) Jun 16 11:55:10.276116 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: spawned uWSGI worker 2 (pid: 125055, cores: 1) Jun 16 11:55:10.276278 dv-cinder-846146-2-iscsi devstack@n-api.service[125052]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 11:55:10.934449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 11:55:10.936357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 11:55:12.183591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:55:12.183591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: from cryptography.utils import int_from_bytes Jun 16 11:55:12.184638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:55:12.184638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: from cryptography.utils import int_from_bytes Jun 16 11:55:12.187848 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:55:12.187848 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: from cryptography.utils import int_from_bytes Jun 16 11:55:12.188314 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:55:12.188314 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: from cryptography.utils import int_from_bytes Jun 16 11:55:14.631495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 11:55:14.632125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 11:55:14.632207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 11:55:14.632570 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 11:55:14.632827 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 11:55:14.633211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.633439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 11:55:14.633821 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.633910 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 11:55:14.633989 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.634157 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.634256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 11:55:14.634468 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.634581 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 11:55:14.634780 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.634907 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 11:55:14.635104 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.635200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.635421 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.635544 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.635746 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.635863 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.636031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.636199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.636351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.636521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.636682 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-2-iscsi {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.636837 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.636994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.637157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.637310 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.637464 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.637721 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.637817 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.637916 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.638005 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.638173 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.638319 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.638506 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.638662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-2-iscsi {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.638814 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.638955 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.639236 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.639401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.640097 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.640404 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.640734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.640883 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.641165 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.641385 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.642090 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.642351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.642567 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.642783 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.642986 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.643200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.643439 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.643439 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.643851 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.644124 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.644341 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.644341 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.644771 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-2-iscsi {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.644978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.645194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.645194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.645611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.645827 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.646038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.646038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.646419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.646602 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.646788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.646950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.647109 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.647292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.647478 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.647630 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.647787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.647787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.648155 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-2-iscsi {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.648308 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.648457 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.648605 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.648997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.649147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.649332 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.649501 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.649644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.650279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.650454 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.650610 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.650758 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.650899 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.651068 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.651221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.651370 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.651517 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.651752 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.652008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.652158 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.652308 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.652455 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.652602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.652749 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.652897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.653049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.653204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.653351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.654066 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.654226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.654377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.654377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.654686 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.654827 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.654968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.655117 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.655266 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.655424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.655572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.655572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.655849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.656048 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.656213 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.656354 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.656503 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.656503 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.656797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.656947 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.657101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.657101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.657975 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.658119 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.658261 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.658411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.658575 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.658734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.659049 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.659198 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.659347 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.659497 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.659638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.659786 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.660326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.660573 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.660730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.660881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.661033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.661193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.661337 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.661486 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.661636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.661803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.662038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.662191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.662333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.662482 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.662631 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.662784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.662935 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.663087 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.663235 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.663375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.663531 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.663679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.663820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.663992 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.664135 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.664284 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.664513 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.664663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.664806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.664946 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.665106 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.665256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.665410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.665410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.665685 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.665826 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.665973 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.666114 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.666263 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.666410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.666562 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.666709 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.666857 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.667016 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.667165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.667316 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.667456 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.667605 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.667753 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.667934 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.668082 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.668230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.668378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.668526 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.668685 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.668838 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.669155 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.669318 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.669469 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.669636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.669920 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.670486 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.670746 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.670897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.671038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.671186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.671326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.671475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.671638 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.677919 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.678109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.678265 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.678427 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.678589 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.678736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.678893 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.679045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.679374 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.679533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.679684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.679825 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.680016 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.680170 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.680744 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.681003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.681163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.681306 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.681456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.681597 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.681738 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.681878 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.682017 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.682165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.682320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.687830 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.688290 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.688450 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.688607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.688757 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.688908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.689058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.689210 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.689387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.689542 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.689691 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.689839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.690002 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.690152 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.690293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.690458 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.690652 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.690812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.690984 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.691620 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.691785 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.691949 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.692114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.692255 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.692416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.692571 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.692719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.692868 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.693016 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.693163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.693316 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.693464 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.693612 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.693878 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.694021 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.694171 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.694319 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.694460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.694611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.694753 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.694904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.695054 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.695242 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.695383 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.695523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.695663 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.695812 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.695995 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.696146 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.696286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.696435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.696583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.696730 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.696886 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.697028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.697175 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.697315 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:55:14.697465 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.697618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.697766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.698201 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.698358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.698501 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.698662 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.698818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.698960 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.699108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.699259 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.699401 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.699548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.699699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.699840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.700021 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.700163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.700303 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.700470 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.700627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.700784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.700932 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.701079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.701250 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.701923 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.702075 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.702227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.702369 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.702510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.702660 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.702802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.702966 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.703116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.703259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.703406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.703554 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.703696 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.704009 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.704666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.704816 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.704964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.705111 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.705252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.705402 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.705561 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.705703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.705842 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.705982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.706122 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.706274 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.706425 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.706565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.706705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.706845 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.709014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.709014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.709671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.709832 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.709986 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.710133 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.710292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.710436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.710588 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.710741 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.710883 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.711024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.711173 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.711323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.711487 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.712136 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.712290 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.712443 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.712696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.712845 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.712985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.713126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.713265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.713422 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.713563 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.713712 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.713861 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.713861 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.714148 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.714304 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.714454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.714595 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.714735 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.714875 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.715023 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.715173 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.715314 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.715454 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.715601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.715742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.715742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.716071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.716214 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.716360 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.716501 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.716648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.716929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.717102 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.717247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.717389 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.717529 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.717677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.717832 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.717981 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.718414 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.718671 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.718825 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.718968 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.719119 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.719260 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.719408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.719549 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.720396 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.720565 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.720723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.720873 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.721033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.721175 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.721323 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.721472 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.721627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.722330 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.722490 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.722632 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.722892 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.723055 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.723198 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.723346 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.723495 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.723648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.723789 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.723971 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.724128 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.724271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.724411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.724559 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.724789 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.724952 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.725102 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.725252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.725402 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.725550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.725709 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.725860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.726000 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.726141 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.726281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.726422 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.726571 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.726719 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.726867 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.727018 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.727159 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.727300 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.727300 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.727595 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.727736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.727892 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.728051 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.728199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.728349 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.728499 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.728668 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.728910 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.729057 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.729211 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.729353 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.729512 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.729654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.729795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.729960 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.730191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.730349 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.730491 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.730657 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.730935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731243 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731392 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.731533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.740172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.740172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.740172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.740172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.740172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.740172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.740172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.740172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.741351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.741351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.741351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.741351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.741351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.741351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.741351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.741351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.742900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.742900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.742900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.742900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.742900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.742900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.742900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.742900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.744099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.744099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.744099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.744099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.744099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.744099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.744099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.744099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.745272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.745413 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.745556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.745556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.745839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.746604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.746812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.746989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.747140 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.747292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.747434 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.747862 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.748052 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.748196 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.748337 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.748477 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.748617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.748765 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.748954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749252 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.749542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.750574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.750715 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.750868 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.751159 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.751324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.751480 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.751620 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.751781 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.751781 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.752140 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.752793 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.752957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.753140 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.753311 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.753581 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.753743 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.753891 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.753891 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.754230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.754404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.754567 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.754738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.754894 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.755040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.755040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.755380 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.755536 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.755685 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.755838 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.756066 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.756222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.756222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.756516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.756670 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.756837 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.756983 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.757138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.757318 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.757469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.757623 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.757780 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.757934 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.758090 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.758238 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.758399 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.758546 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.758693 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.758850 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.759011 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.759159 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.759159 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.759600 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.759992 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.760163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.760323 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.760323 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.760611 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.760758 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.760907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.761363 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.761525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.761672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.761820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.761964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.762072 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.762167 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.762302 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.762410 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.762410 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.763120 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.763225 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.763362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.763531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.763676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.763802 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.763980 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764082 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764177 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764261 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764434 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764678 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764769 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764853 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.764934 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765096 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765096 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765267 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765542 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765626 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765716 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765806 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765895 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.765984 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.766067 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.766149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.766239 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.766329 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.766411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.766491 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.767149 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.767247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.767339 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.767474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.767602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.767697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.767781 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.767862 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.775485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.775696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.775793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.775915 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776373 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776464 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776555 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776729 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776831 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.776964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777061 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777146 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777399 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777489 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777670 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777754 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777836 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.777925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778017 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778272 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778402 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778504 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778590 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778679 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778769 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.778950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779048 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779215 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779296 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779505 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779704 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779801 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.779930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780017 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780290 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780380 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780561 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780724 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780810 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780892 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.780982 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781245 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781328 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781409 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781409 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781562 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.781973 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.782058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.782256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783022 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783322 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783405 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783808 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.783994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784089 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784455 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784546 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.784962 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.785053 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.785264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.785360 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.785451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.785616 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.785776 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.785925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.786084 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.786240 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.786401 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.786590 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.786763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.786914 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.787075 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.787231 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.787387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.787578 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.787739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.788055 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.788232 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.788393 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.788549 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.788725 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.788888 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789051 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789147 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789299 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789438 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789517 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789596 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789815 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789884 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.789963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790114 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790263 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790417 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790498 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790498 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790645 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790874 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.790943 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791010 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791078 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791146 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791363 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791432 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791501 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791708 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791834 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.791936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792077 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792289 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792515 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792630 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792746 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.792864 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.793163 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.793297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.793416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.793535 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.793746 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.793876 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.793987 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.794663 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.794779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.794905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.795045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.795181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.795309 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.795437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.795575 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.795716 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.795844 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.795990 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.796129 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.796258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.796384 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.796524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.796653 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.796788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.796922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.797050 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.797166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.797301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.797430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.797556 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.797684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.797845 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.797982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798084 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798169 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798259 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798343 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798426 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798517 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798847 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.798929 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.799019 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.799150 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.799277 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.799403 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.799528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.799683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.799780 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.799995 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800085 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800447 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800539 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800629 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800720 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800895 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.800985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801068 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801226 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801315 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801408 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801586 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801801 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.801946 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802084 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802211 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802878 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.802975 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.803074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.803074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.803423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.803516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.803599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.803752 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.803903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.803903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804075 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804167 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804167 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804167 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804385 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804476 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804642 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804732 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804815 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.804996 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805141 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805276 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805364 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805447 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805539 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805629 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805720 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805804 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.805955 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.806166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.806296 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.806422 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.806548 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.806673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.806800 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.806918 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807009 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807140 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807232 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807316 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807405 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807502 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.807979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810197 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810319 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810498 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810673 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810854 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.810948 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811137 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811303 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811625 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811715 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811805 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.811963 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812065 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812151 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812233 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812322 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812495 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812828 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.812919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813010 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813196 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813296 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.813993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814231 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814348 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814453 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814526 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814595 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814866 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.814957 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.815040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.815181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.815311 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.815438 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.815575 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.815710 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.815838 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.815983 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816070 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816141 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816424 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816526 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816624 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816721 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816805 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.816997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817339 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817502 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817585 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.817942 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818026 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818198 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818454 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818535 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818624 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818716 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818799 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818881 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.818963 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819217 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819300 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819389 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819811 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.819909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820007 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820499 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820752 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820844 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.820927 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821016 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821448 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821614 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821704 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821796 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821880 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.821962 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822051 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822135 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822225 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822316 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822408 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822499 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822747 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822842 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.822926 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823007 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823089 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823171 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823261 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823715 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823825 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.823927 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824177 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824177 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824353 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824445 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824528 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824528 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.824954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.825171 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.825266 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.825395 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.825522 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.825649 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.825743 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.825827 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.825919 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826010 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826139 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826493 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826673 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826763 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826847 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.826936 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827032 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827128 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827299 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827480 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827480 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.827910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828007 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828185 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828355 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828446 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828532 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828712 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828803 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828895 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.828986 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.829610 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.829697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.829768 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.829851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.829932 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830122 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830215 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830306 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830390 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830562 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830654 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830745 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830911 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.830999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831183 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831356 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831445 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831621 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831712 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831803 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.831944 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.832033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.833154 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.833283 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.833398 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.833500 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.833593 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.833677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.833832 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.833922 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834012 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834104 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834435 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834525 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834797 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.834898 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835273 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835345 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835425 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835505 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835605 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835683 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835753 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835822 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835923 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.835998 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836067 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836299 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836379 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836559 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836639 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836718 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836895 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.836986 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.837202 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.837202 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.837481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.837584 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.837669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.837669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.837819 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.837957 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838054 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838147 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838231 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838320 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838715 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838896 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.838979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839198 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839289 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839380 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839463 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839545 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839641 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839739 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839830 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.839978 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.840064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.840145 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.840240 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.840398 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.840493 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.840583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.840715 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.840809 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.841034 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.841138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.841342 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.841441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.841650 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.841740 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.841965 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.842056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.842261 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.842350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.842564 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.842662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.842874 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.842964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.843451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.843597 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.843754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.843955 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.844100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.844292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.844413 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.844603 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.845385 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.845562 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.845912 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.846075 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.846239 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.846371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.846548 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.846691 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.846873 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.847035 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.847179 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.847347 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.847484 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.847652 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.847745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.847988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.848083 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.848302 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.848411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.848619 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.848773 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.848942 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.849114 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.849247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.849361 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.849561 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.849711 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.849868 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.850005 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.850181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.850328 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.850478 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.850618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.850767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.850942 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.851091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.851244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.851408 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.851553 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.851725 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.851823 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.852062 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.852174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.852369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.852470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.852675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.852773 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.852983 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.853126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.853297 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.853498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.853606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.853809 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.853933 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.854134 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.854292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.854453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.854770 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.854870 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.855081 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.855171 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.855391 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.855481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.855711 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.855829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.856060 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.856183 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.856320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.856458 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.856626 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.856733 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.856930 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.857016 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.857226 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.857352 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.857540 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.857671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.857843 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.857934 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.858141 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.858232 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.858451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.858543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.858753 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.858842 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.859062 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.859278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.859377 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.859624 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.859721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.859955 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.860050 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.860298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.860905 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.861119 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.861209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.861432 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.861522 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.861736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.861834 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.862055 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.862160 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.862356 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.862454 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.862656 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.862748 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.862963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.863053 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.863267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.863364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.863566 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.863700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.863863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.863987 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.864194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.864342 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.864498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.864625 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.864796 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.864887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.865102 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.865201 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.865400 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.865497 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.865721 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.865849 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.866154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.866297 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.866418 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.866554 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.866643 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.866813 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.866914 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.867136 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.867244 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.867459 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.867560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.867763 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.867896 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.868102 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.868205 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.868408 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.868507 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.868707 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.868811 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.869013 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.869103 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.869317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.869416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.869658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.869814 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.869910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.869995 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.870207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.870298 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.870551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.870726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.870868 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.870966 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.871166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.871255 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.871463 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.871554 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.871769 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.871895 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.872131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.872276 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.872424 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.872524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.872727 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.872825 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.873039 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.873166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.873347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.873458 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.873659 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.873751 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.873961 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.874183 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.874290 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.874515 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.874617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.874830 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.874930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.875135 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.875227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.875439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.875531 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.875742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.875834 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.876675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.876773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.876899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.877054 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.877202 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.877296 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.877510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.877603 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.877812 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.877911 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.878116 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.878207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.878417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.878516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.878720 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.878809 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.879019 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.879119 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.879328 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.879419 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.879633 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.879723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.879959 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.880069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.880267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.880358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.880571 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.880661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.880877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.880976 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.881183 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.881281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.881492 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.881627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.881812 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.881903 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.882124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.882214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.882431 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.882561 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.882744 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.883055 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.883152 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.883364 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.883657 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.883748 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.883980 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.884285 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.884373 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.884595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.884872 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.884970 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.885209 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.885452 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.885551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.885908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.886008 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.886214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.886533 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.886664 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.886848 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.887217 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.887327 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.887617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.887769 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.887947 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.888259 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.888358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.888576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.888774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.888876 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.889087 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.889199 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.889507 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.889662 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.889749 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.889880 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.890061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.890197 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.890416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.890580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.890728 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.890828 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.891031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.891138 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.891329 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.891434 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.891666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.891760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.891994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.892092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.892297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.892416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.892591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.892691 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.892897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.892997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.893194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.893313 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.893512 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.893639 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.893789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.893972 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.894074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.894305 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.894398 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.894658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.894759 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.894959 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.895120 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.895267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.895423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.895565 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.895703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.895852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.896023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.896164 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.896339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.896485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.896649 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.896799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.896949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 11:55:14.897106 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.897358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.897617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.897913 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.898237 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.898564 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.898872 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.899191 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.899496 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.899810 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.900138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.900452 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.900767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.901074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.901377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.901702 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.902008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.902313 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.902618 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.902925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.903258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.903564 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.903907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.904230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.904532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.904850 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.905162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.905474 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.905784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.906089 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.906413 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.906717 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.907025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.907853 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.908177 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.908482 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.908794 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.909105 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.909426 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.909751 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.910056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.910376 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.910697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.911038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.911345 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.911680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.912036 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.912346 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.912650 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.912949 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:55:14.913189 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 11:55:14.960320 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO dbcounter [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Registered counter for database nova_api Jun 16 11:55:14.976192 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO dbcounter [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Registered counter for database nova_api Jun 16 11:55:14.981095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_db.sqlalchemy.engines [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:55:14.988462 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writer thread running {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:55:14.996275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125054) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:55:15.002924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writer thread running {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:55:15.045448 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.context [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0(cell1) {{(pid=125055) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 11:55:15.050177 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:55:15.051729 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:55:15.052560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:55:15.054502 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:55:15.056528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO dbcounter [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Registered counter for database nova_cell0 Jun 16 11:55:15.059551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.context [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0(cell1) {{(pid=125054) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 11:55:15.060392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO dbcounter [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Registered counter for database nova_cell1 Jun 16 11:55:15.064027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:55:15.065603 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:55:15.066394 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:55:15.068396 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:55:15.068773 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_db.sqlalchemy.engines [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:55:15.069903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_db.sqlalchemy.engines [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:55:15.070430 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO dbcounter [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Registered counter for database nova_cell0 Jun 16 11:55:15.074367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO dbcounter [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Registered counter for database nova_cell1 Jun 16 11:55:15.076826 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writer thread running {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:55:15.078304 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writer thread running {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:55:15.082113 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125054) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:55:15.083784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125054) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:55:15.088823 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writer thread running {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:55:15.226994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO dbcounter [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Registered counter for database nova_cell0 Jun 16 11:55:15.227948 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writer thread running {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:55:15.233851 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_db.sqlalchemy.engines [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:55:15.238862 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO dbcounter [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Registered counter for database nova_cell0 Jun 16 11:55:15.239056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writer thread running {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:55:15.245220 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125054) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:55:15.250448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writer thread running {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:55:15.566396 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: WARNING keystonemiddleware.auth_token [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 11:55:15.566597 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: WARNING keystonemiddleware.auth_token [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 11:55:15.576537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: WARNING keystonemiddleware.auth_token [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 11:55:15.576658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: WARNING keystonemiddleware.auth_token [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 11:55:15.916671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: WARNING keystonemiddleware.auth_token [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 11:55:15.918674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: WARNING keystonemiddleware.auth_token [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 11:55:15.922831 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: WARNING keystonemiddleware.auth_token [None req-14f8858a-cfc6-435c-b0bc-e797b9bdb795 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 11:55:15.925776 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: WARNING keystonemiddleware.auth_token [None req-7cb2b868-ca6c-494c-9f88-400bad662529 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 11:55:15.929385 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5625f46a09c0 pid: 125055 (default app) Jun 16 11:55:15.931388 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5625f46a09c0 pid: 125054 (default app) Jun 16 11:55:54.675763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:55:54.676522 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:55:54.677470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:55:54.678279 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:55:56.105013 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7f19dedf-923f-4fc5-8778-d55629e389c3 tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Action: 'create', calling method: .version_select at 0x7f433635d790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1824947931", "metadata": {"Type": "work"}}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:55:58.579649 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7f19dedf-923f-4fc5-8778-d55629e389c3 tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.910635 Jun 16 11:55:58.588298 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jun 16 11:55:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3915 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 11:55:59.062200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c199a402-bcb5-4209-8c89-039a89966e83 tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Calling method '.version_select at 0x7f4336d649d0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:55:59.094807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=3 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:55:59.096148 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=3 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:55:59.097477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=3 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:55:59.098582 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=3 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:55:59.569903 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c199a402-bcb5-4209-8c89-039a89966e83 tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776" status: 200 len: 353 microversion: 2.1 time: 0.979379 Jun 16 11:55:59.570857 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 1/2] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 11:55:58 2022] GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776 => generated 353 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:56:00.261335 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-41433d3a-b5ce-4836-8e09-af6b15b11fe0 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f43362255e0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:00.525564 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-41433d3a-b5ce-4836-8e09-af6b15b11fe0 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0eb77752-2694-49f0-880b-7a71a7fb676a" status: 200 len: 350 microversion: 2.1 time: 0.241020 Jun 16 11:56:00.525564 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 11:56:00 2022] GET /compute/v2.1/os-volumes/0eb77752-2694-49f0-880b-7a71a7fb676a => generated 350 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:00.860115 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8ae4da95-f9f8-4a06-aa52-01fc6db20ad3 tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Calling method '.version_select at 0x7f433626a8b0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:01.062320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8ae4da95-f9f8-4a06-aa52-01fc6db20ad3 tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776" status: 200 len: 354 microversion: 2.1 time: 0.483234 Jun 16 11:56:01.062973 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 11:56:00 2022] GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776 => generated 354 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:01.075714 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-671868d2-82ed-4649-bfae-dcc89c362fd1 tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Calling method '.version_select at 0x7f4336225940>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:01.242249 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-671868d2-82ed-4649-bfae-dcc89c362fd1 tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776" status: 200 len: 354 microversion: 2.1 time: 0.169737 Jun 16 11:56:01.243169 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 11:56:01 2022] GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776 => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:01.273894 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f54b7402-a5f4-4a1a-9151-fd504ededa3a tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Calling method '.version_select at 0x7f433626a280>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:01.848797 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f54b7402-a5f4-4a1a-9151-fd504ededa3a tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776" status: 202 len: 0 microversion: 2.1 time: 0.593375 Jun 16 11:56:01.852535 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 11:56:01 2022] DELETE /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 11:56:01.859705 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-bc51f853-725d-4af3-90eb-8d4c8d5e821b tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Calling method '.version_select at 0x7f4336225dc0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:01.998826 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-bc51f853-725d-4af3-90eb-8d4c8d5e821b tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776" status: 200 len: 353 microversion: 2.1 time: 0.144962 Jun 16 11:56:01.999453 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 11:56:01 2022] GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:56:02.925974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9c73e29f-4758-4d78-9cfc-17b78e7ef9dc tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f43362320d0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:03.010660 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f1f125aa-800c-4e6a-9c2d-95a077177cbd tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Calling method '.version_select at 0x7f433623d4c0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:03.040389 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9c73e29f-4758-4d78-9cfc-17b78e7ef9dc tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5684ef76-13b3-4966-ba5a-379db87a0ece" status: 200 len: 350 microversion: 2.1 time: 0.117934 Jun 16 11:56:03.041317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 11:56:02 2022] GET /compute/v2.1/os-volumes/5684ef76-13b3-4966-ba5a-379db87a0ece => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:03.075988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-f1f125aa-800c-4e6a-9c2d-95a077177cbd tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] HTTP exception thrown: Volume 8a69eea8-1503-42ae-b3a2-b4e4e7e13776 could not be found. Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f1f125aa-800c-4e6a-9c2d-95a077177cbd tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Request method failure captured: Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776 HTTP/1.1 Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpKdbWcHsFLYDUFjVv7oN1cB38axakMDHW1dKx4PZy5ZLolm9Lk9PXMpkuTT5duvz4Ynm36o8vR3c4A7LuyFqWb9tY03pVOE6bK5OJoE1XAnDsUcF8UwvMsZ-iKdVcX1qh2VSAlNSIcgJJN93zj7X1LDkO0gUvB4fFb0HEd6skNxHo Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: e8013c8355144c5799d338a4065584f5 Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesGetTestJSON-806952792 Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 11:56:03.081706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e8013c8355144c5799d338a4065584f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e8013c8355144c5799d338a4065584f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e8013c8355144c5799d338a4065584f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e8013c8355144c5799d338a4065584f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesGetTestJSON-806952792 Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: e8013c8355144c5799d338a4065584f5 Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesGetTestJSON-806952792 Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesGetTestJSON-806952792-project Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: fe76d1513055439987cff3d6819b2639 Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesGetTestJSON-806952792-project Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Volume 8a69eea8-1503-42ae-b3a2-b4e4e7e13776 could not be found. Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '8a69eea8-1503-42ae-b3a2-b4e4e7e13776'} Jun 16 11:56:03.082794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a69eea8-1503-42ae-b3a2-b4e4e7e13776 could not be found. (HTTP 404) (Request-ID: req-13837854-600a-444f-921a-ec870800157c) Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:56:03.083388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 11:56:03.086162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a69eea8-1503-42ae-b3a2-b4e4e7e13776 could not be found. Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 11:56:03.088043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a69eea8-1503-42ae-b3a2-b4e4e7e13776 could not be found. Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a69eea8-1503-42ae-b3a2-b4e4e7e13776 could not be found. Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f1f125aa-800c-4e6a-9c2d-95a077177cbd tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] Returning 404 to user: Volume 8a69eea8-1503-42ae-b3a2-b4e4e7e13776 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f1f125aa-800c-4e6a-9c2d-95a077177cbd tempest-VolumesGetTestJSON-806952792 tempest-VolumesGetTestJSON-806952792-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776" status: 404 len: 109 microversion: 2.1 time: 0.076493 Jun 16 11:56:03.088938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 11:56:03 2022] GET /compute/v2.1/os-volumes/8a69eea8-1503-42ae-b3a2-b4e4e7e13776 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 11:56:05.304131 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c8a85b31-5dbe-4229-82bb-649fdbc03159 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f4336232820>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:05.464354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c8a85b31-5dbe-4229-82bb-649fdbc03159 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d2042c02-cbb3-4232-a372-589d3781ec68" status: 200 len: 350 microversion: 2.1 time: 0.164591 Jun 16 11:56:05.467524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 5/10] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 11:56:05 2022] GET /compute/v2.1/os-volumes/d2042c02-cbb3-4232-a372-589d3781ec68 => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:05.479933 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d390a4fe-645d-4218-833c-cc0ce84e8cf9 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f433623de50>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:05.700305 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d390a4fe-645d-4218-833c-cc0ce84e8cf9 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.224442 Jun 16 11:56:05.709060 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1133 bytes} [Thu Jun 16 11:56:05 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:05.713872 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-549eb54c-d7cc-469f-9b57-66934d4cb8f2 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f433626aee0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:05.928652 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-549eb54c-d7cc-469f-9b57-66934d4cb8f2 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.218320 Jun 16 11:56:05.935657 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1148 bytes} [Thu Jun 16 11:56:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:05.943010 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5bde3d05-abdf-4129-8807-47d179278ed3 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f433623daf0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:06.187907 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5bde3d05-abdf-4129-8807-47d179278ed3 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.248825 Jun 16 11:56:06.190705 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1133 bytes} [Thu Jun 16 11:56:05 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:06.207297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-99cbfa6a-27fb-42fd-bdfb-c54785ae2b5a tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f4336232940>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:06.399532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-99cbfa6a-27fb-42fd-bdfb-c54785ae2b5a tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.201699 Jun 16 11:56:06.400442 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 7/14] 10.222.0.40 () {58 vars in 1166 bytes} [Thu Jun 16 11:56:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:06.414152 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-daac1700-b111-4191-87b7-b839c7d0cda2 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f4336245550>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:06.664440 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-daac1700-b111-4191-87b7-b839c7d0cda2 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.255381 Jun 16 11:56:06.665648 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1169 bytes} [Thu Jun 16 11:56:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:06.677909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ab312083-429f-4740-afc2-fd2fd4710c18 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f433626a4c0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:06.835787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ab312083-429f-4740-afc2-fd2fd4710c18 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.161951 Jun 16 11:56:06.837271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1154 bytes} [Thu Jun 16 11:56:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:06.848706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a389fa79-3154-471a-8a01-e9d8548d02f6 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f43361ab1f0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:07.023261 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a389fa79-3154-471a-8a01-e9d8548d02f6 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.178538 Jun 16 11:56:07.030245 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 9/17] 10.222.0.40 () {58 vars in 1187 bytes} [Thu Jun 16 11:56:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:07.037098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-57feda53-3f9b-424e-81a1-3df81cd7d5b0 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] Calling method '.version_select at 0x7f43362323a0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:07.238304 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-57feda53-3f9b-424e-81a1-3df81cd7d5b0 tempest-VolumesTestJSON-1249977161 tempest-VolumesTestJSON-1249977161-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.206416 Jun 16 11:56:07.238920 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 9/18] 10.222.0.40 () {58 vars in 1154 bytes} [Thu Jun 16 11:56:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:11.743114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1743222614", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "networks": [{"uuid": "811532f9-2778-47df-9c94-32a2f889c3db"}]}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:11.952817 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] validate_networks() for [('811532f9-2778-47df-9c94-32a2f889c3db', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:56:13.052173 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6f3009ac-83a9-4b98-9a91-4f3fbf8fcafb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'create', calling method: .version_select at 0x7f433626aee0>, body: {"keypair": {"name": "tempest-keypair-2101293772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGawyIQUmOPokmDKiKt9l9ZjIBzXM6J63lakY2SQpjN47HPZWYSlHlDPfJBQjzt/V4R2wgn5xEs7sTg/bmXiDShbLsP9/VkWDVixz7FYSe9wKc7RLBk5xVLfsitplKU/kA=="}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:13.120166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-6f3009ac-83a9-4b98-9a91-4f3fbf8fcafb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Getting quotas for project 918001434f5c4d76a3ab9c46616eec67. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:56:13.127142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-6f3009ac-83a9-4b98-9a91-4f3fbf8fcafb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Getting quotas for user 13d8c04611e24dffad16f8bb97e111f2 and project 918001434f5c4d76a3ab9c46616eec67. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:56:13.315426 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6f3009ac-83a9-4b98-9a91-4f3fbf8fcafb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.075354 Jun 16 11:56:13.316923 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 10/19] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 11:56:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:13.854573 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1549100478", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:14.018157 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] validate_networks() for [('950be268-f975-4428-bdc1-84f1abeb0a4f', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:56:14.394349 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:56:14.394868 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:56:14.395446 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:56:14.396000 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:56:14.397104 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:56:14.427839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:14.428759 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:14.430058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:14.430728 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:14.512136 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Getting quotas for project 7f23e9a6fbe44c69bb3e4ae47bfe93dc. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:56:14.520087 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Getting quotas for user fae075fce4d94d679a8dc5f508a1c3cf and project 7f23e9a6fbe44c69bb3e4ae47bfe93dc. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:56:14.549189 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:56:14.558037 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:56:14.830208 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-960a2fdc-0038-4c88-8693-ecb0354f53d6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.582377 Jun 16 11:56:14.831399 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 10/20] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 11:56:15.333988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-61288509-2cb4-4b1d-a687-1955a23c31cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'create', calling method: .version_select at 0x7f43358aa1f0>, body: {"keypair": {"name": "tempest-keypair-1766578446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZAFi5lHYGQVqakVULmEsVocPr8XSHFbCS3OraEz3zT1ospxMXfqeCEMzm63wrqRG/lt5l9pbl+hPKCxZ4W8BHf5NmZprbk/a6s8ebKjjZSjC9/NnXHhyPeCQWkI211jw=="}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:15.385679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-61288509-2cb4-4b1d-a687-1955a23c31cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Getting quotas for project 659db25373614c8da6fc81e59ef9c6f6. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:56:15.394289 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-61288509-2cb4-4b1d-a687-1955a23c31cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Getting quotas for user 97ce6d944eb74b9794d6d0d5f18d4bad and project 659db25373614c8da6fc81e59ef9c6f6. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:56:15.538626 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-61288509-2cb4-4b1d-a687-1955a23c31cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.696568 Jun 16 11:56:15.539230 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 11/21] 10.222.0.40 () {62 vars in 1199 bytes} [Thu Jun 16 11:56:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 698 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 11:56:15.545784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f5c44799-e43d-4c79-9468-a270521c480d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:15.546262 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f5c44799-e43d-4c79-9468-a270521c480d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:15.766654 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f5c44799-e43d-4c79-9468-a270521c480d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:15.801502 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f5c44799-e43d-4c79-9468-a270521c480d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1215 microversion: 2.1 time: 0.261201 Jun 16 11:56:15.806041 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 12/22] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:15 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1215 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:16.822818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e33a68b4-5470-45ba-a8c5-1598fb0092ec tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:16.826027 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e33a68b4-5470-45ba-a8c5-1598fb0092ec tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:16.957192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e33a68b4-5470-45ba-a8c5-1598fb0092ec tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:16.975703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e33a68b4-5470-45ba-a8c5-1598fb0092ec tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1215 microversion: 2.1 time: 0.153133 Jun 16 11:56:16.977543 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 13/23] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:16 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:17.284176 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:56:17.284176 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:56:17.284761 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:56:17.285083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:56:17.285454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:56:17.316967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:17.320087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:17.321082 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:17.321514 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:17.460516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Getting quotas for project ce5409289ccf4aad8d62b13a72d0009e. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:56:17.474016 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Getting quotas for user 6cdd0a7f3f12414ea85ebffc9d531773 and project ce5409289ccf4aad8d62b13a72d0009e. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:56:17.507200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:56:17.517395 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:56:17.834864 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8065a912-fad1-49af-b730-76ecc6b63815 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.516518 Jun 16 11:56:17.835656 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 11/24] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:56:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 4518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 11:56:17.849064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d8a563a9-9651-4a5f-b649-12cd85ecd7c6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:17.850486 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d8a563a9-9651-4a5f-b649-12cd85ecd7c6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:17.994618 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9bc2aea7-bd67-4a9e-a6a8-6a2760cf67e1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:17.995357 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9bc2aea7-bd67-4a9e-a6a8-6a2760cf67e1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:18.009372 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d8a563a9-9651-4a5f-b649-12cd85ecd7c6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:18.044622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d8a563a9-9651-4a5f-b649-12cd85ecd7c6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1222 microversion: 2.1 time: 0.194077 Jun 16 11:56:18.046603 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:17 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:18.351333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1406736430", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:18.466367 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] validate_networks() for [('950be268-f975-4428-bdc1-84f1abeb0a4f', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:56:18.535002 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9bc2aea7-bd67-4a9e-a6a8-6a2760cf67e1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:18.563123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9bc2aea7-bd67-4a9e-a6a8-6a2760cf67e1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1215 microversion: 2.1 time: 0.572867 Jun 16 11:56:18.568914 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 12/26] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:17 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1215 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:19.585292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6820ebd9-a2fe-452a-ae19-06d0d96fcd12 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:19.586609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6820ebd9-a2fe-452a-ae19-06d0d96fcd12 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:19.599577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6820ebd9-a2fe-452a-ae19-06d0d96fcd12 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:19.603419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6820ebd9-a2fe-452a-ae19-06d0d96fcd12 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:19.604507 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6820ebd9-a2fe-452a-ae19-06d0d96fcd12 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:19.605584 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6820ebd9-a2fe-452a-ae19-06d0d96fcd12 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:19.877286 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:56:19.877828 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:56:19.878365 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:56:19.883193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:56:19.883193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:56:19.894629 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:19.895340 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:19.899197 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:19.899859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:19.940778 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Getting quotas for project ce5409289ccf4aad8d62b13a72d0009e. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:56:19.948912 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Getting quotas for user 6cdd0a7f3f12414ea85ebffc9d531773 and project ce5409289ccf4aad8d62b13a72d0009e. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:56:19.976310 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6820ebd9-a2fe-452a-ae19-06d0d96fcd12 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:19.978930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:56:19.985968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:56:20.006908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6820ebd9-a2fe-452a-ae19-06d0d96fcd12 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1219 microversion: 2.1 time: 0.425872 Jun 16 11:56:20.017919 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 13/27] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:19 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1219 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:20.140370 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-43c61a51-74fc-42fc-8ffa-bc9b81a0a114 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.810192 Jun 16 11:56:20.154946 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 15/28] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:56:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 11:56:20.167126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4ca4f08a-0725-477a-9f83-63e427af2c0a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:20.167746 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4ca4f08a-0725-477a-9f83-63e427af2c0a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:20.319258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4ca4f08a-0725-477a-9f83-63e427af2c0a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:20.327659 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4ca4f08a-0725-477a-9f83-63e427af2c0a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1222 microversion: 2.1 time: 0.166523 Jun 16 11:56:20.338740 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 14/29] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:20 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:20.371195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2054500095", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28a421b2-7f17-4f12-b999-37b4d5461541"}], "security_groups": [{"name": "tempest-securitygroup--1637376550"}], "key_name": "tempest-keypair-2101293772", "user_data": "}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:20.803237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] validate_networks() for [('28a421b2-7f17-4f12-b999-37b4d5461541', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:56:21.027739 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9cae10b3-8568-4e6e-ac9b-9ebf4e01bf8b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:21.029543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9cae10b3-8568-4e6e-ac9b-9ebf4e01bf8b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:21.046299 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9cae10b3-8568-4e6e-ac9b-9ebf4e01bf8b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:21.046778 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9cae10b3-8568-4e6e-ac9b-9ebf4e01bf8b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:21.049492 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9cae10b3-8568-4e6e-ac9b-9ebf4e01bf8b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:21.051234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9cae10b3-8568-4e6e-ac9b-9ebf4e01bf8b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:21.371175 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9cae10b3-8568-4e6e-ac9b-9ebf4e01bf8b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:21.379790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9cae10b3-8568-4e6e-ac9b-9ebf4e01bf8b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1267 microversion: 2.1 time: 0.357962 Jun 16 11:56:21.400602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 15/30] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:21 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1267 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:21.412817 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-87c9cd1d-2425-499a-99d8-3313595f9cae tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:21.422426 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-87c9cd1d-2425-499a-99d8-3313595f9cae tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:21.591815 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-87c9cd1d-2425-499a-99d8-3313595f9cae tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:21.628619 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-87c9cd1d-2425-499a-99d8-3313595f9cae tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1222 microversion: 2.1 time: 0.198959 Jun 16 11:56:21.632801 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 16/31] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:21 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:21.638252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-376292318", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6088f5f2-7ffc-4d4b-af08-9c80eec0b3aa"}], "security_groups": [{"name": "tempest-securitygroup--1680605461"}], "key_name": "tempest-keypair-1766578446", "user_data": "}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:22.426040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] validate_networks() for [('6088f5f2-7ffc-4d4b-af08-9c80eec0b3aa', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:56:22.613908 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:56:22.614439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:56:22.614898 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:56:22.615218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:56:22.615604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:56:22.637887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:22.638624 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:22.640132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:22.640808 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:22.731099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Getting quotas for project 918001434f5c4d76a3ab9c46616eec67. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:56:22.772827 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Getting quotas for user 13d8c04611e24dffad16f8bb97e111f2 and project 918001434f5c4d76a3ab9c46616eec67. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:56:22.856660 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:56:22.870854 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:56:23.094656 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1c14b6f8-0782-461c-a379-47eb267a3627 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.730307 Jun 16 11:56:23.097904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 16/32] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:56:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 11:56:23.115264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e765e80a-a8d5-4d4e-b48e-d37abc97ebb8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:23.119912 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e765e80a-a8d5-4d4e-b48e-d37abc97ebb8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:23.137545 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e765e80a-a8d5-4d4e-b48e-d37abc97ebb8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:23.138247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e765e80a-a8d5-4d4e-b48e-d37abc97ebb8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:23.165297 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e765e80a-a8d5-4d4e-b48e-d37abc97ebb8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:23.169300 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e765e80a-a8d5-4d4e-b48e-d37abc97ebb8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:24.141216 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e765e80a-a8d5-4d4e-b48e-d37abc97ebb8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:24.182137 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e765e80a-a8d5-4d4e-b48e-d37abc97ebb8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1273 microversion: 2.1 time: 1.079106 Jun 16 11:56:24.185608 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 17/33] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:23 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1273 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:24.201770 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-df30ce83-f2b3-4cab-8ab1-7fadf8239c89 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:24.212147 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-df30ce83-f2b3-4cab-8ab1-7fadf8239c89 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:24.237106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-df30ce83-f2b3-4cab-8ab1-7fadf8239c89 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:24.238488 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-df30ce83-f2b3-4cab-8ab1-7fadf8239c89 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:24.241855 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-df30ce83-f2b3-4cab-8ab1-7fadf8239c89 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:24.243430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-df30ce83-f2b3-4cab-8ab1-7fadf8239c89 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:24.391227 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-df30ce83-f2b3-4cab-8ab1-7fadf8239c89 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:24.404934 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-df30ce83-f2b3-4cab-8ab1-7fadf8239c89 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1280 microversion: 2.1 time: 0.217981 Jun 16 11:56:24.408200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 18/34] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:24 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1280 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:24.421942 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-73656b00-5bce-4483-af2b-97b8e228a1ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:24.423033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-73656b00-5bce-4483-af2b-97b8e228a1ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:24.685937 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-73656b00-5bce-4483-af2b-97b8e228a1ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:24.693763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-73656b00-5bce-4483-af2b-97b8e228a1ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1238 microversion: 2.1 time: 0.283236 Jun 16 11:56:24.694544 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 19/35] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:24 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1238 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:25.204781 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-39b6b36e-c0e8-49c1-99d3-45746dc27069 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:25.204781 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-39b6b36e-c0e8-49c1-99d3-45746dc27069 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:25.221785 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-39b6b36e-c0e8-49c1-99d3-45746dc27069 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:25.222237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-39b6b36e-c0e8-49c1-99d3-45746dc27069 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:25.223087 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-39b6b36e-c0e8-49c1-99d3-45746dc27069 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:25.223521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-39b6b36e-c0e8-49c1-99d3-45746dc27069 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:25.459501 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:56:25.461865 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:56:25.463148 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:56:25.464449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:56:25.465087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:56:25.484350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:25.485220 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:25.487933 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:25.490517 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:25.521499 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Getting quotas for project 659db25373614c8da6fc81e59ef9c6f6. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:56:25.533863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Getting quotas for user 97ce6d944eb74b9794d6d0d5f18d4bad and project 659db25373614c8da6fc81e59ef9c6f6. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:56:25.565404 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:56:25.585444 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:56:25.822999 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2e03b83e-2e03-498c-b8aa-a23ad67ef85c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.188884 Jun 16 11:56:25.823654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 17/36] 10.222.0.40 () {62 vars in 1187 bytes} [Thu Jun 16 11:56:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 4190 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 11:56:25.832349 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cd769ae2-6700-4083-9a5f-a2fb6c776ad3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:25.838301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cd769ae2-6700-4083-9a5f-a2fb6c776ad3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:25.872147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd769ae2-6700-4083-9a5f-a2fb6c776ad3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:25.872147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd769ae2-6700-4083-9a5f-a2fb6c776ad3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:25.872147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd769ae2-6700-4083-9a5f-a2fb6c776ad3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:25.872147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd769ae2-6700-4083-9a5f-a2fb6c776ad3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:26.172706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cd769ae2-6700-4083-9a5f-a2fb6c776ad3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:26.193446 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cd769ae2-6700-4083-9a5f-a2fb6c776ad3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1280 microversion: 2.1 time: 0.363561 Jun 16 11:56:26.195066 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 18/37] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:25 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1280 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:26.216667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9f0a70b4-43b6-45ca-abe0-53cbb6afd3e1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:26.218654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9f0a70b4-43b6-45ca-abe0-53cbb6afd3e1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:26.245672 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9f0a70b4-43b6-45ca-abe0-53cbb6afd3e1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:26.253301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9f0a70b4-43b6-45ca-abe0-53cbb6afd3e1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:26.257440 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9f0a70b4-43b6-45ca-abe0-53cbb6afd3e1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:26.259774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9f0a70b4-43b6-45ca-abe0-53cbb6afd3e1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:26.455677 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-39b6b36e-c0e8-49c1-99d3-45746dc27069 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:26.483850 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-39b6b36e-c0e8-49c1-99d3-45746dc27069 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 1.287708 Jun 16 11:56:26.489877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9f0a70b4-43b6-45ca-abe0-53cbb6afd3e1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:26.493396 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 20/38] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:25 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:26.507434 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9f0a70b4-43b6-45ca-abe0-53cbb6afd3e1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1234 microversion: 2.1 time: 0.308376 Jun 16 11:56:26.510025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 19/39] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:26 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1234 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:26.515907 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-42725618-91e3-45c5-9cb4-9d65965fe8b0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:26.516656 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-42725618-91e3-45c5-9cb4-9d65965fe8b0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:26.809663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-42725618-91e3-45c5-9cb4-9d65965fe8b0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:26.822074 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-42725618-91e3-45c5-9cb4-9d65965fe8b0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:26.828115 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-42725618-91e3-45c5-9cb4-9d65965fe8b0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:26.830262 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-42725618-91e3-45c5-9cb4-9d65965fe8b0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1281 microversion: 2.20 time: 0.330055 Jun 16 11:56:26.833555 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:26 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:27.213555 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fa65ee2e-e322-46db-b408-5d2992ccb351 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:27.214175 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-fa65ee2e-e322-46db-b408-5d2992ccb351 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:27.223925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fa65ee2e-e322-46db-b408-5d2992ccb351 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:27.225256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fa65ee2e-e322-46db-b408-5d2992ccb351 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:27.226276 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fa65ee2e-e322-46db-b408-5d2992ccb351 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:27.226877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fa65ee2e-e322-46db-b408-5d2992ccb351 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:27.392194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-fa65ee2e-e322-46db-b408-5d2992ccb351 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:27.424784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-fa65ee2e-e322-46db-b408-5d2992ccb351 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1280 microversion: 2.1 time: 0.214680 Jun 16 11:56:27.437409 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 20/41] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:27 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:27.514535 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ee1881a3-5605-461c-9f91-b0a801818797 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:27.514535 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ee1881a3-5605-461c-9f91-b0a801818797 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:27.545618 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cb209a9b-0778-4daa-8b89-2097e6d02817 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:27.546535 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cb209a9b-0778-4daa-8b89-2097e6d02817 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:27.555851 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ee1881a3-5605-461c-9f91-b0a801818797 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:27.556376 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ee1881a3-5605-461c-9f91-b0a801818797 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:27.557206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ee1881a3-5605-461c-9f91-b0a801818797 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:27.562619 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ee1881a3-5605-461c-9f91-b0a801818797 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:27.567660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb209a9b-0778-4daa-8b89-2097e6d02817 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:27.567660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb209a9b-0778-4daa-8b89-2097e6d02817 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:27.567660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb209a9b-0778-4daa-8b89-2097e6d02817 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:27.567660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb209a9b-0778-4daa-8b89-2097e6d02817 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:27.723897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cb209a9b-0778-4daa-8b89-2097e6d02817 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:27.738243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cb209a9b-0778-4daa-8b89-2097e6d02817 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1298 microversion: 2.1 time: 0.216354 Jun 16 11:56:27.739900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 21/42] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:27 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1298 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:27.851023 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:27.852125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:27.860317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:27.860907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:27.868636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:27.869324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:27.952602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:27.962588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:27.964485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:27.966521 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-afaac8f2-b236-4547-abae-457377f97307 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1285 microversion: 2.20 time: 0.119793 Jun 16 11:56:27.967890 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 22/43] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:27 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:28.442447 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7b8269e2-ae8a-428b-b424-00c632ec6c0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:28.446683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7b8269e2-ae8a-428b-b424-00c632ec6c0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:28.464911 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b8269e2-ae8a-428b-b424-00c632ec6c0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:28.464911 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b8269e2-ae8a-428b-b424-00c632ec6c0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:28.477434 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b8269e2-ae8a-428b-b424-00c632ec6c0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:28.479305 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b8269e2-ae8a-428b-b424-00c632ec6c0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:28.723372 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ee1881a3-5605-461c-9f91-b0a801818797 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:28.762859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ee1881a3-5605-461c-9f91-b0a801818797 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 1.258458 Jun 16 11:56:28.765406 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 22/44] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:27 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:28.770440 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5ca1b7cc-a9e9-4f34-a0a8-11179b62c755 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:28.771350 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5ca1b7cc-a9e9-4f34-a0a8-11179b62c755 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:28.778798 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5ca1b7cc-a9e9-4f34-a0a8-11179b62c755 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:28.780183 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5ca1b7cc-a9e9-4f34-a0a8-11179b62c755 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:28.781432 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5ca1b7cc-a9e9-4f34-a0a8-11179b62c755 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:28.782168 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5ca1b7cc-a9e9-4f34-a0a8-11179b62c755 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:28.826286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7b8269e2-ae8a-428b-b424-00c632ec6c0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:28.845826 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7b8269e2-ae8a-428b-b424-00c632ec6c0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.398394 Jun 16 11:56:28.847725 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 23/45] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:28 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:28.987584 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:28.988525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:28.999048 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:29.002157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5ca1b7cc-a9e9-4f34-a0a8-11179b62c755 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:29.002958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:29.003960 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:29.007329 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:29.016734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5ca1b7cc-a9e9-4f34-a0a8-11179b62c755 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1296 microversion: 2.1 time: 0.250056 Jun 16 11:56:29.019316 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 23/46] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:28 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1296 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:29.146510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:29.156806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:29.164603 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:29.167245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f8977cff-5097-4f54-95fe-c14c203aa32a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1333 microversion: 2.20 time: 0.185742 Jun 16 11:56:29.169818 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 24/47] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:28 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1333 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:56:29.782090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fef1a592-ba0d-45df-89c5-198691d0f851 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:29.782705 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fef1a592-ba0d-45df-89c5-198691d0f851 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:29.796297 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fef1a592-ba0d-45df-89c5-198691d0f851 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:29.797253 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fef1a592-ba0d-45df-89c5-198691d0f851 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:29.798395 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fef1a592-ba0d-45df-89c5-198691d0f851 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:29.798938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fef1a592-ba0d-45df-89c5-198691d0f851 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:29.864254 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-08203775-1f32-4b8b-8ed8-274c392c59a3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:29.864911 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-08203775-1f32-4b8b-8ed8-274c392c59a3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:29.879351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-08203775-1f32-4b8b-8ed8-274c392c59a3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:29.879806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-08203775-1f32-4b8b-8ed8-274c392c59a3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:29.880727 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-08203775-1f32-4b8b-8ed8-274c392c59a3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:29.885608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-08203775-1f32-4b8b-8ed8-274c392c59a3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:30.187522 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-08203775-1f32-4b8b-8ed8-274c392c59a3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:30.199565 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-08203775-1f32-4b8b-8ed8-274c392c59a3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.336868 Jun 16 11:56:30.209732 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 25/48] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:29 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:30.215514 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ab7e7b5a-a4d6-4865-8002-cc8768e34a1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:30.216927 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ab7e7b5a-a4d6-4865-8002-cc8768e34a1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:30.223706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ab7e7b5a-a4d6-4865-8002-cc8768e34a1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:30.224406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ab7e7b5a-a4d6-4865-8002-cc8768e34a1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:30.225722 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ab7e7b5a-a4d6-4865-8002-cc8768e34a1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:30.227549 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ab7e7b5a-a4d6-4865-8002-cc8768e34a1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:30.383242 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ab7e7b5a-a4d6-4865-8002-cc8768e34a1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:30.407068 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ab7e7b5a-a4d6-4865-8002-cc8768e34a1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1296 microversion: 2.1 time: 0.193003 Jun 16 11:56:30.409805 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 26/49] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:30 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:30.421913 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:30.425784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:30.454129 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:30.456703 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:30.462478 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:30.462953 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:30.541404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fef1a592-ba0d-45df-89c5-198691d0f851 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:30.554319 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fef1a592-ba0d-45df-89c5-198691d0f851 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.777479 Jun 16 11:56:30.556916 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 24/50] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:29 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:30.692631 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:30.702780 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:30.704530 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:30.705632 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e4fc36e5-b209-4b6e-9cae-966f666af0df tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1339 microversion: 2.20 time: 0.294740 Jun 16 11:56:30.716544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 27/51] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:30 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1339 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:31.223154 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-17977b10-c021-4e75-9cf3-acd54ae4f83f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:31.223154 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-17977b10-c021-4e75-9cf3-acd54ae4f83f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:31.234330 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17977b10-c021-4e75-9cf3-acd54ae4f83f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:31.235070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17977b10-c021-4e75-9cf3-acd54ae4f83f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:31.238741 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17977b10-c021-4e75-9cf3-acd54ae4f83f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:31.240390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17977b10-c021-4e75-9cf3-acd54ae4f83f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:31.426419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c4668672-a613-4914-a43e-89fe49066433 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:31.427455 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c4668672-a613-4914-a43e-89fe49066433 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:31.439401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4668672-a613-4914-a43e-89fe49066433 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:31.439401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4668672-a613-4914-a43e-89fe49066433 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:31.439401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4668672-a613-4914-a43e-89fe49066433 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:31.439401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4668672-a613-4914-a43e-89fe49066433 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:31.703307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c4668672-a613-4914-a43e-89fe49066433 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:31.711230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c4668672-a613-4914-a43e-89fe49066433 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1296 microversion: 2.1 time: 0.288517 Jun 16 11:56:31.728546 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 28/52] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:31 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1296 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:31.734192 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-46746840-f3a3-40ae-80e0-ba2930db68e6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:31.737028 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-46746840-f3a3-40ae-80e0-ba2930db68e6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:31.752338 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46746840-f3a3-40ae-80e0-ba2930db68e6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:31.754637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46746840-f3a3-40ae-80e0-ba2930db68e6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:31.756979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46746840-f3a3-40ae-80e0-ba2930db68e6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:31.757974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46746840-f3a3-40ae-80e0-ba2930db68e6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:32.358477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-46746840-f3a3-40ae-80e0-ba2930db68e6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:32.381374 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-46746840-f3a3-40ae-80e0-ba2930db68e6 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.651451 Jun 16 11:56:32.394443 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 29/53] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:31 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:32.413228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:32.417083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:32.435290 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:32.438737 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:32.438737 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:32.438737 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:32.602912 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-17977b10-c021-4e75-9cf3-acd54ae4f83f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:32.623179 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-17977b10-c021-4e75-9cf3-acd54ae4f83f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 1.408330 Jun 16 11:56:32.627272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 25/54] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:31 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:32.731689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0302e5bc-f1d1-4a59-b62c-49b60d25ebaa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:32.732388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0302e5bc-f1d1-4a59-b62c-49b60d25ebaa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:32.746067 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=6 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:32.752237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0302e5bc-f1d1-4a59-b62c-49b60d25ebaa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:32.754246 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0302e5bc-f1d1-4a59-b62c-49b60d25ebaa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:32.768399 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0302e5bc-f1d1-4a59-b62c-49b60d25ebaa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:32.768959 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0302e5bc-f1d1-4a59-b62c-49b60d25ebaa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:32.995247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:33.013818 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:33.015241 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:33.016444 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c1417db2-1240-4988-b65d-f29e4949aaba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.620665 Jun 16 11:56:33.017011 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 30/55] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:32 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:33.406558 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6b7259ff-e2be-43f9-ad12-8560703fb9a7 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:33.407477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6b7259ff-e2be-43f9-ad12-8560703fb9a7 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:33.429774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6b7259ff-e2be-43f9-ad12-8560703fb9a7 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:33.438797 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6b7259ff-e2be-43f9-ad12-8560703fb9a7 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:33.444608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6b7259ff-e2be-43f9-ad12-8560703fb9a7 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:33.445418 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6b7259ff-e2be-43f9-ad12-8560703fb9a7 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:33.957126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6b7259ff-e2be-43f9-ad12-8560703fb9a7 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:33.963369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:33.974706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6b7259ff-e2be-43f9-ad12-8560703fb9a7 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.573478 Jun 16 11:56:33.978599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 31/56] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:33 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:33.990376 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-33e41530-4363-4456-b06e-b437aca73bdf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:33.991180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-33e41530-4363-4456-b06e-b437aca73bdf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:34.006142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-33e41530-4363-4456-b06e-b437aca73bdf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:34.009900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-33e41530-4363-4456-b06e-b437aca73bdf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:34.013833 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-33e41530-4363-4456-b06e-b437aca73bdf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:34.014489 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-33e41530-4363-4456-b06e-b437aca73bdf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:34.297514 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-33e41530-4363-4456-b06e-b437aca73bdf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:34.309036 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-33e41530-4363-4456-b06e-b437aca73bdf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.329195 Jun 16 11:56:34.321237 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 32/57] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:33 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:34.331407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:34.335136 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:34.345644 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:34.354268 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:34.360033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:34.360666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:34.591159 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0302e5bc-f1d1-4a59-b62c-49b60d25ebaa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:34.621391 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0302e5bc-f1d1-4a59-b62c-49b60d25ebaa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 1.893560 Jun 16 11:56:34.641081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 26/58] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:32 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:34.851346 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:34.860748 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:34.866140 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:34.869073 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0367a535-9b17-46c3-af1f-c778dafaf2a7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.546449 Jun 16 11:56:34.882335 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 33/59] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:34 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:34.995212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e1e96d65-d1dc-41bf-8da2-ab0bd98ea47b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:35.003666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e1e96d65-d1dc-41bf-8da2-ab0bd98ea47b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:35.022805 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e1e96d65-d1dc-41bf-8da2-ab0bd98ea47b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.025418 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e1e96d65-d1dc-41bf-8da2-ab0bd98ea47b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.028023 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e1e96d65-d1dc-41bf-8da2-ab0bd98ea47b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.028451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e1e96d65-d1dc-41bf-8da2-ab0bd98ea47b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.116653 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-b7cb0dda-bcef-4271-9026-c9e5cd185f71 req-cd2954a9-0e01-40fd-a818-12656d7e948c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8294f9b2-7466-4a10-b810-dcc3515bb498", "tag": "2df61128-89ae-431f-93db-63b6038696a5"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:35.139133 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:35.141426 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-b7cb0dda-bcef-4271-9026-c9e5cd185f71 req-cd2954a9-0e01-40fd-a818-12656d7e948c service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.141875 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-b7cb0dda-bcef-4271-9026-c9e5cd185f71 req-cd2954a9-0e01-40fd-a818-12656d7e948c service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.208660 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-b7cb0dda-bcef-4271-9026-c9e5cd185f71 req-cd2954a9-0e01-40fd-a818-12656d7e948c service nova] Creating event network-changed:2df61128-89ae-431f-93db-63b6038696a5 for instance 8294f9b2-7466-4a10-b810-dcc3515bb498 on hv-cinder-84614 Jun 16 11:56:35.211978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-b7cb0dda-bcef-4271-9026-c9e5cd185f71 req-cd2954a9-0e01-40fd-a818-12656d7e948c service nova] Acquired lock "compute-rpcapi-router" {{(pid=125055) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 11:56:35.214621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd98d2f1-6dfd-48db-adb1-76ec7a5a59be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.216562 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd98d2f1-6dfd-48db-adb1-76ec7a5a59be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.222788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd98d2f1-6dfd-48db-adb1-76ec7a5a59be None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.224461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd98d2f1-6dfd-48db-adb1-76ec7a5a59be None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.265666 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.compute.rpcapi [None req-bd98d2f1-6dfd-48db-adb1-76ec7a5a59be None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 11:56:35.272906 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd98d2f1-6dfd-48db-adb1-76ec7a5a59be None None] Releasing lock "compute-rpcapi-router" {{(pid=125055) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 11:56:35.328103 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-bd98d2f1-6dfd-48db-adb1-76ec7a5a59be None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.691816 Jun 16 11:56:35.329421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 27/60] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:35.335959 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-012af8a0-0f50-48d0-b817-a8875a5e6f59 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:35.338869 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-012af8a0-0f50-48d0-b817-a8875a5e6f59 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:35.359325 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-012af8a0-0f50-48d0-b817-a8875a5e6f59 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.362208 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-012af8a0-0f50-48d0-b817-a8875a5e6f59 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.366568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-012af8a0-0f50-48d0-b817-a8875a5e6f59 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.366568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-012af8a0-0f50-48d0-b817-a8875a5e6f59 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.508558 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e1e96d65-d1dc-41bf-8da2-ab0bd98ea47b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:35.518357 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=4 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:35.549464 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e1e96d65-d1dc-41bf-8da2-ab0bd98ea47b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.554042 Jun 16 11:56:35.550185 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 34/61] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:34 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:35.645560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=22 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:35.655622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-da86f6be-08b2-4f99-8e79-7272052d0f7a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:35.657331 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-da86f6be-08b2-4f99-8e79-7272052d0f7a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:35.679260 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-da86f6be-08b2-4f99-8e79-7272052d0f7a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.679710 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-da86f6be-08b2-4f99-8e79-7272052d0f7a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.680523 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-da86f6be-08b2-4f99-8e79-7272052d0f7a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:35.680950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-da86f6be-08b2-4f99-8e79-7272052d0f7a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:35.934826 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-012af8a0-0f50-48d0-b817-a8875a5e6f59 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:35.941074 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=63 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:35.967033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-012af8a0-0f50-48d0-b817-a8875a5e6f59 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.635685 Jun 16 11:56:35.974294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 28/62] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:35 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:36.129578 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-0d3e77be-72ba-4597-8d36-b4bbb995a981 req-59cf67b9-2537-45af-87bd-d477cac49789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6646f09a-70e9-487b-98f0-89ab1fe5508a", "tag": "e8a94066-1a49-45d0-9264-0c1a6dbdacde"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:36.150095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-0d3e77be-72ba-4597-8d36-b4bbb995a981 req-59cf67b9-2537-45af-87bd-d477cac49789 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:36.150565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-0d3e77be-72ba-4597-8d36-b4bbb995a981 req-59cf67b9-2537-45af-87bd-d477cac49789 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:36.181870 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-0d3e77be-72ba-4597-8d36-b4bbb995a981 req-59cf67b9-2537-45af-87bd-d477cac49789 service nova] Creating event network-changed:e8a94066-1a49-45d0-9264-0c1a6dbdacde for instance 6646f09a-70e9-487b-98f0-89ab1fe5508a on hv-cinder-84614 Jun 16 11:56:36.190750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-0d3e77be-72ba-4597-8d36-b4bbb995a981 req-59cf67b9-2537-45af-87bd-d477cac49789 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215056 Jun 16 11:56:36.192650 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 29/63] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:36.201468 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:36.206743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:36.221939 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:36.224936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:36.226860 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:36.228444 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:36.440991 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-da86f6be-08b2-4f99-8e79-7272052d0f7a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:36.455770 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-da86f6be-08b2-4f99-8e79-7272052d0f7a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.810450 Jun 16 11:56:36.465820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 35/64] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:35 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:36.569797 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-463d9c02-0083-41a5-bbcf-a06bb0e33102 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:36.570942 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-463d9c02-0083-41a5-bbcf-a06bb0e33102 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:36.582719 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:36.584802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-463d9c02-0083-41a5-bbcf-a06bb0e33102 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:36.585731 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-463d9c02-0083-41a5-bbcf-a06bb0e33102 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:36.589783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-463d9c02-0083-41a5-bbcf-a06bb0e33102 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:36.589783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-463d9c02-0083-41a5-bbcf-a06bb0e33102 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:36.817924 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=32 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:37.024439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:37.033035 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:37.034533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:37.035674 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9b8f8ba6-615a-4d10-ab82-096e97989327 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.841745 Jun 16 11:56:37.045036 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 30/65] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:36 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:37.054562 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4586f3c9-c4e8-40f2-adf0-376463b9a696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:37.054562 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4586f3c9-c4e8-40f2-adf0-376463b9a696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:37.068892 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4586f3c9-c4e8-40f2-adf0-376463b9a696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:37.069534 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4586f3c9-c4e8-40f2-adf0-376463b9a696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:37.070479 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4586f3c9-c4e8-40f2-adf0-376463b9a696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:37.071057 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4586f3c9-c4e8-40f2-adf0-376463b9a696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:37.505518 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4586f3c9-c4e8-40f2-adf0-376463b9a696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:37.524825 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4586f3c9-c4e8-40f2-adf0-376463b9a696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.477491 Jun 16 11:56:37.525605 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 31/66] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:37 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:37.530753 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-9a50b241-ee5d-42a5-9bfd-182accd5f800 req-96cacb30-1d53-48f2-8ef2-7bcfcb859961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48de9379-fb44-4eb9-b03d-e38ece0b999c", "tag": "d5802430-5f4b-4e91-8489-b3d080bd24dc"}, {"name": "network-changed", "server_uuid": "a0cfe043-70c3-4137-b979-cfab2e3c1bab", "tag": "d8badd83-339f-4e1b-8b96-c3f43fb0a109"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:37.535021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-463d9c02-0083-41a5-bbcf-a06bb0e33102 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:37.550660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-463d9c02-0083-41a5-bbcf-a06bb0e33102 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.986704 Jun 16 11:56:37.560579 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-9a50b241-ee5d-42a5-9bfd-182accd5f800 req-96cacb30-1d53-48f2-8ef2-7bcfcb859961 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:37.562347 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 36/67] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:36 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:37.565237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-9a50b241-ee5d-42a5-9bfd-182accd5f800 req-96cacb30-1d53-48f2-8ef2-7bcfcb859961 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:37.570111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8316cc40-1043-494f-b3fe-b423376cdbd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:37.571181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8316cc40-1043-494f-b3fe-b423376cdbd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:37.580420 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8316cc40-1043-494f-b3fe-b423376cdbd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:37.581449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8316cc40-1043-494f-b3fe-b423376cdbd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:37.583140 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8316cc40-1043-494f-b3fe-b423376cdbd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:37.583892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8316cc40-1043-494f-b3fe-b423376cdbd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:37.590379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-9a50b241-ee5d-42a5-9bfd-182accd5f800 req-96cacb30-1d53-48f2-8ef2-7bcfcb859961 service nova] Creating event network-changed:d5802430-5f4b-4e91-8489-b3d080bd24dc for instance 48de9379-fb44-4eb9-b03d-e38ece0b999c on hv-cinder-84614 Jun 16 11:56:37.598194 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-9a50b241-ee5d-42a5-9bfd-182accd5f800 req-96cacb30-1d53-48f2-8ef2-7bcfcb859961 service nova] Creating event network-changed:d8badd83-339f-4e1b-8b96-c3f43fb0a109 for instance a0cfe043-70c3-4137-b979-cfab2e3c1bab on hv-cinder-84614 Jun 16 11:56:37.599761 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-9a50b241-ee5d-42a5-9bfd-182accd5f800 req-96cacb30-1d53-48f2-8ef2-7bcfcb859961 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072475 Jun 16 11:56:37.600547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 32/68] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:38.071105 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:38.072586 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:38.089013 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8316cc40-1043-494f-b3fe-b423376cdbd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:38.101834 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:38.104638 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:38.106779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:38.108398 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:38.109218 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8316cc40-1043-494f-b3fe-b423376cdbd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.542922 Jun 16 11:56:38.111577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 37/69] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:37 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:38.418117 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:38.426765 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:38.428608 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:38.429751 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c300e774-8771-4672-8f13-3491444fce42 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.362997 Jun 16 11:56:38.430299 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 33/70] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:38 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:56:38.542610 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a4293262-75b9-407e-8909-c0ee112312ed tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:38.547595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a4293262-75b9-407e-8909-c0ee112312ed tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:38.549836 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a4293262-75b9-407e-8909-c0ee112312ed tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:38.556449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a4293262-75b9-407e-8909-c0ee112312ed tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:38.557263 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a4293262-75b9-407e-8909-c0ee112312ed tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:38.557700 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a4293262-75b9-407e-8909-c0ee112312ed tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:38.568583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-08198bbf-07c8-455a-8af1-6f04cd28cc76 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:38.569196 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-08198bbf-07c8-455a-8af1-6f04cd28cc76 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:38.581019 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-08198bbf-07c8-455a-8af1-6f04cd28cc76 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:38.581763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-08198bbf-07c8-455a-8af1-6f04cd28cc76 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:38.582725 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-08198bbf-07c8-455a-8af1-6f04cd28cc76 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:38.583311 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-08198bbf-07c8-455a-8af1-6f04cd28cc76 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:38.744413 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a4293262-75b9-407e-8909-c0ee112312ed tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:38.752787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a4293262-75b9-407e-8909-c0ee112312ed tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.214163 Jun 16 11:56:38.753470 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 38/71] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:38 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:38.889059 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-08198bbf-07c8-455a-8af1-6f04cd28cc76 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:38.896604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-08198bbf-07c8-455a-8af1-6f04cd28cc76 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.332280 Jun 16 11:56:38.897369 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 34/72] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:38 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:39.132016 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fd46b3b1-a501-4215-bf09-4aea41a462a2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:39.132016 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-fd46b3b1-a501-4215-bf09-4aea41a462a2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:39.135799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fd46b3b1-a501-4215-bf09-4aea41a462a2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.136289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fd46b3b1-a501-4215-bf09-4aea41a462a2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.137043 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fd46b3b1-a501-4215-bf09-4aea41a462a2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.137474 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fd46b3b1-a501-4215-bf09-4aea41a462a2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.282910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-fd46b3b1-a501-4215-bf09-4aea41a462a2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:39.290951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-fd46b3b1-a501-4215-bf09-4aea41a462a2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.166830 Jun 16 11:56:39.292977 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 39/73] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:39 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:39.447788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:39.448427 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:39.454655 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.457547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.457547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.457547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.589720 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:39.598856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:39.601172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:39.602637 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fd1ddce7-485d-459e-b5b0-7904f518966c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.158783 Jun 16 11:56:39.603182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 35/74] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:39 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:39.621639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-eb0787c8-3ab9-47ea-b319-7c4d5d447cf4 req-0b47416d-7131-40ff-b14b-a9cc50d0db4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd786b9e-48e7-4695-8549-aeabb6511e72", "tag": "ebc45963-7af0-458c-bad2-2f2724cd51e0"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:39.640907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-eb0787c8-3ab9-47ea-b319-7c4d5d447cf4 req-0b47416d-7131-40ff-b14b-a9cc50d0db4b service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.641820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-eb0787c8-3ab9-47ea-b319-7c4d5d447cf4 req-0b47416d-7131-40ff-b14b-a9cc50d0db4b service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.662942 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-eb0787c8-3ab9-47ea-b319-7c4d5d447cf4 req-0b47416d-7131-40ff-b14b-a9cc50d0db4b service nova] Creating event network-changed:ebc45963-7af0-458c-bad2-2f2724cd51e0 for instance bd786b9e-48e7-4695-8549-aeabb6511e72 on hv-cinder-84614 Jun 16 11:56:39.663471 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-eb0787c8-3ab9-47ea-b319-7c4d5d447cf4 req-0b47416d-7131-40ff-b14b-a9cc50d0db4b service nova] Acquired lock "compute-rpcapi-router" {{(pid=125054) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 11:56:39.664711 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-77de5707-9fb0-4a95-872f-cb2793c49b97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.665140 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-77de5707-9fb0-4a95-872f-cb2793c49b97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.666268 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-77de5707-9fb0-4a95-872f-cb2793c49b97 None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.666693 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-77de5707-9fb0-4a95-872f-cb2793c49b97 None None] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.677455 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.compute.rpcapi [None req-77de5707-9fb0-4a95-872f-cb2793c49b97 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 11:56:39.678337 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-77de5707-9fb0-4a95-872f-cb2793c49b97 None None] Releasing lock "compute-rpcapi-router" {{(pid=125054) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 11:56:39.699406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-77de5707-9fb0-4a95-872f-cb2793c49b97 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084381 Jun 16 11:56:39.700155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 40/75] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:39.769696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-67cc8bec-e5b8-420f-bec0-2fe31c658d83 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:39.770228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-67cc8bec-e5b8-420f-bec0-2fe31c658d83 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:39.776360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-67cc8bec-e5b8-420f-bec0-2fe31c658d83 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.777509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-67cc8bec-e5b8-420f-bec0-2fe31c658d83 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.777509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-67cc8bec-e5b8-420f-bec0-2fe31c658d83 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.777947 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-67cc8bec-e5b8-420f-bec0-2fe31c658d83 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.913834 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8ec48644-872b-4dd5-8c1f-8215b300d5f8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:39.914579 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8ec48644-872b-4dd5-8c1f-8215b300d5f8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:39.918784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-67cc8bec-e5b8-420f-bec0-2fe31c658d83 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:39.921704 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8ec48644-872b-4dd5-8c1f-8215b300d5f8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.922146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8ec48644-872b-4dd5-8c1f-8215b300d5f8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.922902 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8ec48644-872b-4dd5-8c1f-8215b300d5f8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:39.923328 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8ec48644-872b-4dd5-8c1f-8215b300d5f8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:39.927122 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-67cc8bec-e5b8-420f-bec0-2fe31c658d83 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.161475 Jun 16 11:56:39.929895 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 36/76] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:39 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:40.069934 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8ec48644-872b-4dd5-8c1f-8215b300d5f8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:40.080616 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8ec48644-872b-4dd5-8c1f-8215b300d5f8 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.170924 Jun 16 11:56:40.081200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 41/77] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:39 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:40.310656 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f4bc3678-b965-41cb-9d58-0a9ae4cff2cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:40.310656 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f4bc3678-b965-41cb-9d58-0a9ae4cff2cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:40.316853 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4bc3678-b965-41cb-9d58-0a9ae4cff2cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:40.317290 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4bc3678-b965-41cb-9d58-0a9ae4cff2cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:40.318044 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4bc3678-b965-41cb-9d58-0a9ae4cff2cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:40.318473 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4bc3678-b965-41cb-9d58-0a9ae4cff2cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:40.530562 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f4bc3678-b965-41cb-9d58-0a9ae4cff2cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:40.539042 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f4bc3678-b965-41cb-9d58-0a9ae4cff2cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.233197 Jun 16 11:56:40.539617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 37/78] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:40 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:40.622373 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:40.622960 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:40.630799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:40.632543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:40.633351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:40.633863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:40.807114 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:40.815795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:40.818406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:40.819662 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1ea43824-3465-4821-83d3-2c428426bb9e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.202846 Jun 16 11:56:40.820894 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 42/79] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:40 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:40.943719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e4614638-57fa-43f0-a7ee-48d1b8670774 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:40.944355 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e4614638-57fa-43f0-a7ee-48d1b8670774 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:40.950259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4614638-57fa-43f0-a7ee-48d1b8670774 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:40.950707 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4614638-57fa-43f0-a7ee-48d1b8670774 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:40.951514 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4614638-57fa-43f0-a7ee-48d1b8670774 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:40.951976 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4614638-57fa-43f0-a7ee-48d1b8670774 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:41.077800 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e4614638-57fa-43f0-a7ee-48d1b8670774 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:41.085113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e4614638-57fa-43f0-a7ee-48d1b8670774 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.145260 Jun 16 11:56:41.090193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 38/80] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:40 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:41.097183 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a6dd5f7c-b8a6-40bc-8298-948a91c799b1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:41.097781 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a6dd5f7c-b8a6-40bc-8298-948a91c799b1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:41.103617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f7c-b8a6-40bc-8298-948a91c799b1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:41.104087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f7c-b8a6-40bc-8298-948a91c799b1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:41.104830 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f7c-b8a6-40bc-8298-948a91c799b1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:41.105251 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f7c-b8a6-40bc-8298-948a91c799b1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:41.241851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a6dd5f7c-b8a6-40bc-8298-948a91c799b1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:41.249417 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a6dd5f7c-b8a6-40bc-8298-948a91c799b1 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.156274 Jun 16 11:56:41.253656 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 43/81] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:41 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:41.556130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4e21f141-da1d-41a9-ac0e-b0ac58f80169 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:41.566106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4e21f141-da1d-41a9-ac0e-b0ac58f80169 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:41.566106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e21f141-da1d-41a9-ac0e-b0ac58f80169 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:41.566106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e21f141-da1d-41a9-ac0e-b0ac58f80169 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:41.566106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e21f141-da1d-41a9-ac0e-b0ac58f80169 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:41.566579 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e21f141-da1d-41a9-ac0e-b0ac58f80169 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:41.809140 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4e21f141-da1d-41a9-ac0e-b0ac58f80169 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:41.830195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4e21f141-da1d-41a9-ac0e-b0ac58f80169 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.277790 Jun 16 11:56:41.842047 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:41.842047 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:41.843095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 39/82] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:41 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:41.848159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:41.848604 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:41.849388 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:41.849818 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:42.053916 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:42.062676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:42.065309 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:42.067040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7ba33c8b-6005-49ee-b6a0-f883aa8576cc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.231472 Jun 16 11:56:42.068229 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 44/83] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:41 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:56:42.107625 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3aa1f13e-25d5-426e-9687-1771973ff2f6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:42.108268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3aa1f13e-25d5-426e-9687-1771973ff2f6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:42.121661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3aa1f13e-25d5-426e-9687-1771973ff2f6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:42.122873 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3aa1f13e-25d5-426e-9687-1771973ff2f6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:42.124059 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3aa1f13e-25d5-426e-9687-1771973ff2f6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:42.124645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3aa1f13e-25d5-426e-9687-1771973ff2f6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:42.268093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-538186aa-ef22-47b3-b20e-39590af3d704 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:42.268701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-538186aa-ef22-47b3-b20e-39590af3d704 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:42.276059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-538186aa-ef22-47b3-b20e-39590af3d704 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:42.276726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-538186aa-ef22-47b3-b20e-39590af3d704 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:42.278278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-538186aa-ef22-47b3-b20e-39590af3d704 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:42.279091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-538186aa-ef22-47b3-b20e-39590af3d704 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:42.289820 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3aa1f13e-25d5-426e-9687-1771973ff2f6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:42.302658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3aa1f13e-25d5-426e-9687-1771973ff2f6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.204074 Jun 16 11:56:42.304461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 40/84] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:42 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:42.483476 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-538186aa-ef22-47b3-b20e-39590af3d704 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:42.492673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-538186aa-ef22-47b3-b20e-39590af3d704 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.228343 Jun 16 11:56:42.494203 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 45/85] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:42 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:42.852144 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3e0395c1-7658-46ea-bd28-6a8c0cacfe0b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:42.852633 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3e0395c1-7658-46ea-bd28-6a8c0cacfe0b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:42.859506 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e0395c1-7658-46ea-bd28-6a8c0cacfe0b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:42.860095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e0395c1-7658-46ea-bd28-6a8c0cacfe0b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:42.861056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e0395c1-7658-46ea-bd28-6a8c0cacfe0b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:42.861568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e0395c1-7658-46ea-bd28-6a8c0cacfe0b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:43.046217 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3e0395c1-7658-46ea-bd28-6a8c0cacfe0b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:43.055578 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3e0395c1-7658-46ea-bd28-6a8c0cacfe0b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.208915 Jun 16 11:56:43.056551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 41/86] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:42 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:43.087660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:43.089200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:43.097020 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:43.097732 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:43.098602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:43.099108 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:43.242672 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:43.252830 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:43.254314 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:43.255407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bb79f75b-c3c5-4fd7-916d-68064cae4de9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.173532 Jun 16 11:56:43.256002 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 46/87] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:43 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:43.324633 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b2ec920b-7bda-4020-9d9c-2708e4c0706b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:43.324633 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b2ec920b-7bda-4020-9d9c-2708e4c0706b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:43.329174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b2ec920b-7bda-4020-9d9c-2708e4c0706b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:43.329621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b2ec920b-7bda-4020-9d9c-2708e4c0706b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:43.330382 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b2ec920b-7bda-4020-9d9c-2708e4c0706b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:43.330807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b2ec920b-7bda-4020-9d9c-2708e4c0706b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:43.471495 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b2ec920b-7bda-4020-9d9c-2708e4c0706b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:43.477552 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b2ec920b-7bda-4020-9d9c-2708e4c0706b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.161539 Jun 16 11:56:43.478128 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 42/88] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:43 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:43.513803 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1e7c4469-fca4-4362-b1a1-90ee457337fc tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:43.514495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-1e7c4469-fca4-4362-b1a1-90ee457337fc tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:43.520592 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1e7c4469-fca4-4362-b1a1-90ee457337fc tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:43.521038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1e7c4469-fca4-4362-b1a1-90ee457337fc tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:43.521793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1e7c4469-fca4-4362-b1a1-90ee457337fc tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:43.522221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1e7c4469-fca4-4362-b1a1-90ee457337fc tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:43.648974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1e7c4469-fca4-4362-b1a1-90ee457337fc tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:43.658234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1e7c4469-fca4-4362-b1a1-90ee457337fc tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.148630 Jun 16 11:56:43.659411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 47/89] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:43 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:44.076419 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ba3b0a53-79db-4690-9327-3b9433ee070e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:44.076781 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ba3b0a53-79db-4690-9327-3b9433ee070e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:44.085737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba3b0a53-79db-4690-9327-3b9433ee070e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:44.086192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba3b0a53-79db-4690-9327-3b9433ee070e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:44.086995 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba3b0a53-79db-4690-9327-3b9433ee070e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:44.087434 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba3b0a53-79db-4690-9327-3b9433ee070e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:44.273349 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:44.274100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:44.274258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ba3b0a53-79db-4690-9327-3b9433ee070e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:44.284978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ba3b0a53-79db-4690-9327-3b9433ee070e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.214448 Jun 16 11:56:44.295471 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:44.295471 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:44.295951 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 43/90] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:44 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:44.296045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:44.296045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:44.457735 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:44.466653 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:44.470721 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:44.473898 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:44.475238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a354dd8e-48f3-41d6-835c-1ff5ef89ca0c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.206191 Jun 16 11:56:44.476708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 48/91] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:44 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:56:44.495027 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4e7511c3-a98d-42a6-b4f4-10e7442b0e11 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:44.495702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4e7511c3-a98d-42a6-b4f4-10e7442b0e11 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:44.503470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e7511c3-a98d-42a6-b4f4-10e7442b0e11 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:44.504116 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e7511c3-a98d-42a6-b4f4-10e7442b0e11 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:44.506870 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e7511c3-a98d-42a6-b4f4-10e7442b0e11 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:44.507486 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e7511c3-a98d-42a6-b4f4-10e7442b0e11 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:44.676184 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5288a38f-72d8-444d-8007-c990be2c03ce tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:44.676972 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5288a38f-72d8-444d-8007-c990be2c03ce tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:44.684433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5288a38f-72d8-444d-8007-c990be2c03ce tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:44.685113 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5288a38f-72d8-444d-8007-c990be2c03ce tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:44.686066 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5288a38f-72d8-444d-8007-c990be2c03ce tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:44.686682 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5288a38f-72d8-444d-8007-c990be2c03ce tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:44.864887 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5288a38f-72d8-444d-8007-c990be2c03ce tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:44.871430 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5288a38f-72d8-444d-8007-c990be2c03ce tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.199041 Jun 16 11:56:44.881574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 49/92] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:44 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:45.017994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4e7511c3-a98d-42a6-b4f4-10e7442b0e11 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:45.027151 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4e7511c3-a98d-42a6-b4f4-10e7442b0e11 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.536358 Jun 16 11:56:45.027733 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 44/93] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:44 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:45.303761 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e700146d-0a78-4760-b2c5-9dcba37ab573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:45.311261 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e700146d-0a78-4760-b2c5-9dcba37ab573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:45.339005 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e700146d-0a78-4760-b2c5-9dcba37ab573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:45.339005 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e700146d-0a78-4760-b2c5-9dcba37ab573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:45.340743 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e700146d-0a78-4760-b2c5-9dcba37ab573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:45.343001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e700146d-0a78-4760-b2c5-9dcba37ab573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:45.494333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:45.495589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:45.497726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:45.502742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:45.503192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:45.503993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:45.504429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:45.552800 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e700146d-0a78-4760-b2c5-9dcba37ab573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:45.564765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e700146d-0a78-4760-b2c5-9dcba37ab573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.265970 Jun 16 11:56:45.574556 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 50/94] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:45 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:45.745264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:45.758158 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:45.759799 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:45.760945 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6fb2ceb3-1bfc-4d29-aacb-abebf2a5f59a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.270703 Jun 16 11:56:45.772002 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 45/95] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:45 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:45.889954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c3901e93-83e7-4bda-a677-429f58e69ec4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:45.890781 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c3901e93-83e7-4bda-a677-429f58e69ec4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:45.897990 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3901e93-83e7-4bda-a677-429f58e69ec4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:45.898434 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3901e93-83e7-4bda-a677-429f58e69ec4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:45.899371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3901e93-83e7-4bda-a677-429f58e69ec4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:45.899800 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3901e93-83e7-4bda-a677-429f58e69ec4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:46.044652 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f474bdb5-16c0-4c8b-b623-4cce3a15a70d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:46.045268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f474bdb5-16c0-4c8b-b623-4cce3a15a70d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:46.056197 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f474bdb5-16c0-4c8b-b623-4cce3a15a70d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:46.056657 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f474bdb5-16c0-4c8b-b623-4cce3a15a70d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:46.060616 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f474bdb5-16c0-4c8b-b623-4cce3a15a70d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:46.061087 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f474bdb5-16c0-4c8b-b623-4cce3a15a70d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:46.093096 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c3901e93-83e7-4bda-a677-429f58e69ec4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:46.105342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c3901e93-83e7-4bda-a677-429f58e69ec4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.220001 Jun 16 11:56:46.106774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 51/96] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:45 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:46.458910 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f474bdb5-16c0-4c8b-b623-4cce3a15a70d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:46.461307 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=100 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:46.468096 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f474bdb5-16c0-4c8b-b623-4cce3a15a70d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.428204 Jun 16 11:56:46.472283 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 46/97] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:46 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:46.583226 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-90d1dffc-18b9-48e3-b470-766c5697ad86 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:46.584085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-90d1dffc-18b9-48e3-b470-766c5697ad86 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:46.598412 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-90d1dffc-18b9-48e3-b470-766c5697ad86 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:46.599252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-90d1dffc-18b9-48e3-b470-766c5697ad86 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:46.601404 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-90d1dffc-18b9-48e3-b470-766c5697ad86 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:46.602009 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-90d1dffc-18b9-48e3-b470-766c5697ad86 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:46.854703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-323fc5e0-f9e3-4284-8574-0ea20bc63f6e req-14b3cf9d-23e7-4ec5-a59a-64c0dfc0a807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8294f9b2-7466-4a10-b810-dcc3515bb498", "name": "network-vif-plugged", "status": "completed", "tag": "2df61128-89ae-431f-93db-63b6038696a5"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:46.884643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-323fc5e0-f9e3-4284-8574-0ea20bc63f6e req-14b3cf9d-23e7-4ec5-a59a-64c0dfc0a807 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:46.887543 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-323fc5e0-f9e3-4284-8574-0ea20bc63f6e req-14b3cf9d-23e7-4ec5-a59a-64c0dfc0a807 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:46.923173 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-323fc5e0-f9e3-4284-8574-0ea20bc63f6e req-14b3cf9d-23e7-4ec5-a59a-64c0dfc0a807 service nova] Creating event network-vif-plugged:2df61128-89ae-431f-93db-63b6038696a5 for instance 8294f9b2-7466-4a10-b810-dcc3515bb498 on hv-cinder-84614 Jun 16 11:56:46.930272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-323fc5e0-f9e3-4284-8574-0ea20bc63f6e req-14b3cf9d-23e7-4ec5-a59a-64c0dfc0a807 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254710 Jun 16 11:56:46.932465 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 47/98] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:56:46.941295 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:46.942395 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:46.951417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:46.952539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:46.953644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:46.954249 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:47.088010 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-90d1dffc-18b9-48e3-b470-766c5697ad86 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:47.099724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-90d1dffc-18b9-48e3-b470-766c5697ad86 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.520769 Jun 16 11:56:47.109648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 52/99] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:46 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:47.122422 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bb01e80c-b4eb-4acb-a919-c8e3dcfd6f08 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:47.123059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bb01e80c-b4eb-4acb-a919-c8e3dcfd6f08 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:47.129897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb01e80c-b4eb-4acb-a919-c8e3dcfd6f08 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:47.130345 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb01e80c-b4eb-4acb-a919-c8e3dcfd6f08 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:47.131117 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb01e80c-b4eb-4acb-a919-c8e3dcfd6f08 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:47.131543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb01e80c-b4eb-4acb-a919-c8e3dcfd6f08 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:47.324329 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bb01e80c-b4eb-4acb-a919-c8e3dcfd6f08 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:47.340508 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bb01e80c-b4eb-4acb-a919-c8e3dcfd6f08 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.221835 Jun 16 11:56:47.352893 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 53/100] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:47 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:47.479565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:47.491345 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-54ddf773-6615-4ce8-b624-9b0e5a63fcf8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:47.492200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-54ddf773-6615-4ce8-b624-9b0e5a63fcf8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:47.501661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:47.505607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54ddf773-6615-4ce8-b624-9b0e5a63fcf8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:47.506266 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54ddf773-6615-4ce8-b624-9b0e5a63fcf8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:47.507213 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54ddf773-6615-4ce8-b624-9b0e5a63fcf8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:47.509625 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54ddf773-6615-4ce8-b624-9b0e5a63fcf8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:47.515911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:47.517070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-90d70fc7-bfa3-464b-8cbe-2f75c9f88a92 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.582954 Jun 16 11:56:47.517921 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 48/101] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:46 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:47.670308 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-54ddf773-6615-4ce8-b624-9b0e5a63fcf8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:47.678969 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-54ddf773-6615-4ce8-b624-9b0e5a63fcf8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.192033 Jun 16 11:56:47.688275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 54/102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:47 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:48.117191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f8378085-302a-4f2b-b8b2-56628b5d7ebe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:48.117804 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f8378085-302a-4f2b-b8b2-56628b5d7ebe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:48.124483 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f8378085-302a-4f2b-b8b2-56628b5d7ebe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.124931 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f8378085-302a-4f2b-b8b2-56628b5d7ebe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.125696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f8378085-302a-4f2b-b8b2-56628b5d7ebe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.126131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f8378085-302a-4f2b-b8b2-56628b5d7ebe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.258724 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f8378085-302a-4f2b-b8b2-56628b5d7ebe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:48.268686 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f8378085-302a-4f2b-b8b2-56628b5d7ebe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.155252 Jun 16 11:56:48.269259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 49/103] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:48 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:48.358332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f29c0219-51f7-4478-8ff5-b98ebfbb6152 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:48.358962 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f29c0219-51f7-4478-8ff5-b98ebfbb6152 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:48.365472 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f29c0219-51f7-4478-8ff5-b98ebfbb6152 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.366357 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f29c0219-51f7-4478-8ff5-b98ebfbb6152 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.367245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f29c0219-51f7-4478-8ff5-b98ebfbb6152 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.367904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f29c0219-51f7-4478-8ff5-b98ebfbb6152 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.535723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:48.535723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:48.546859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.547311 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.552798 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.556756 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.574695 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f29c0219-51f7-4478-8ff5-b98ebfbb6152 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:48.585196 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f29c0219-51f7-4478-8ff5-b98ebfbb6152 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.231370 Jun 16 11:56:48.585775 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 55/104] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:48 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:48.695668 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9352665f-822e-4295-ad58-434c43358498 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:48.704098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9352665f-822e-4295-ad58-434c43358498 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:48.710886 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9352665f-822e-4295-ad58-434c43358498 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.712179 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9352665f-822e-4295-ad58-434c43358498 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.713163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9352665f-822e-4295-ad58-434c43358498 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.713790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9352665f-822e-4295-ad58-434c43358498 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.783411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:48.796934 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:48.798688 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:48.803393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2df1bb75-6803-4c7f-a3f6-c5935a22d154 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.272543 Jun 16 11:56:48.805067 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 50/105] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:48 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:48.888158 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9352665f-822e-4295-ad58-434c43358498 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:48.905732 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9352665f-822e-4295-ad58-434c43358498 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.213701 Jun 16 11:56:48.906315 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 56/106] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:48 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:48.947512 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-9a7164bc-e156-486c-ad7b-e5f7b236e5b4 req-908c94ed-9916-40ec-bfe2-4c8ef5ad0c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48de9379-fb44-4eb9-b03d-e38ece0b999c", "name": "network-vif-plugged", "status": "completed", "tag": "d5802430-5f4b-4e91-8489-b3d080bd24dc"}, {"server_uuid": "a0cfe043-70c3-4137-b979-cfab2e3c1bab", "name": "network-vif-plugged", "status": "completed", "tag": "d8badd83-339f-4e1b-8b96-c3f43fb0a109"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:48.957181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-9a7164bc-e156-486c-ad7b-e5f7b236e5b4 req-908c94ed-9916-40ec-bfe2-4c8ef5ad0c46 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:48.957617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-9a7164bc-e156-486c-ad7b-e5f7b236e5b4 req-908c94ed-9916-40ec-bfe2-4c8ef5ad0c46 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:48.971746 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-9a7164bc-e156-486c-ad7b-e5f7b236e5b4 req-908c94ed-9916-40ec-bfe2-4c8ef5ad0c46 service nova] Creating event network-vif-plugged:d5802430-5f4b-4e91-8489-b3d080bd24dc for instance 48de9379-fb44-4eb9-b03d-e38ece0b999c on hv-cinder-84614 Jun 16 11:56:48.972279 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-9a7164bc-e156-486c-ad7b-e5f7b236e5b4 req-908c94ed-9916-40ec-bfe2-4c8ef5ad0c46 service nova] Creating event network-vif-plugged:d8badd83-339f-4e1b-8b96-c3f43fb0a109 for instance a0cfe043-70c3-4137-b979-cfab2e3c1bab on hv-cinder-84614 Jun 16 11:56:48.980522 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-9a7164bc-e156-486c-ad7b-e5f7b236e5b4 req-908c94ed-9916-40ec-bfe2-4c8ef5ad0c46 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036786 Jun 16 11:56:48.982292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 51/107] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:49.285297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a67a2a5e-1125-49a1-b942-d5615622ab03 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:49.285899 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a67a2a5e-1125-49a1-b942-d5615622ab03 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:49.291711 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a67a2a5e-1125-49a1-b942-d5615622ab03 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:49.292154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a67a2a5e-1125-49a1-b942-d5615622ab03 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:49.293121 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a67a2a5e-1125-49a1-b942-d5615622ab03 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:49.293671 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a67a2a5e-1125-49a1-b942-d5615622ab03 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:49.453857 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a67a2a5e-1125-49a1-b942-d5615622ab03 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:49.461860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a67a2a5e-1125-49a1-b942-d5615622ab03 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.180263 Jun 16 11:56:49.462652 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 57/108] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:49 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:49.602591 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e9b3eb34-50a5-416d-ac34-68d263d99eb4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:49.603391 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e9b3eb34-50a5-416d-ac34-68d263d99eb4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:49.609737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9b3eb34-50a5-416d-ac34-68d263d99eb4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:49.610251 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9b3eb34-50a5-416d-ac34-68d263d99eb4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:49.611229 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9b3eb34-50a5-416d-ac34-68d263d99eb4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:49.611660 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9b3eb34-50a5-416d-ac34-68d263d99eb4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:49.821782 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:49.823167 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:49.825896 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:49.830991 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:49.831627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:49.832629 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:49.833081 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:49.920064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e9b3eb34-50a5-416d-ac34-68d263d99eb4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:49.928018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e9b3eb34-50a5-416d-ac34-68d263d99eb4 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.329330 Jun 16 11:56:49.932800 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 52/109] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:49 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:49.941606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cc6b46a3-37fd-4747-a001-7b6f25157a74 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:49.942118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-cc6b46a3-37fd-4747-a001-7b6f25157a74 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:49.948338 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cc6b46a3-37fd-4747-a001-7b6f25157a74 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:49.948980 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cc6b46a3-37fd-4747-a001-7b6f25157a74 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:49.950430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cc6b46a3-37fd-4747-a001-7b6f25157a74 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:49.950865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cc6b46a3-37fd-4747-a001-7b6f25157a74 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:49.999981 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:50.007806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:50.009329 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:50.010411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c2a3f0fb-cb80-4928-b1d7-a2d72a243dec tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.192691 Jun 16 11:56:50.010957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 58/110] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:49 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:56:50.084437 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-cc6b46a3-37fd-4747-a001-7b6f25157a74 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:50.099479 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-cc6b46a3-37fd-4747-a001-7b6f25157a74 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.169728 Jun 16 11:56:50.100100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 53/111] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:49 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:50.481592 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7e19be2a-65c2-41f2-a03a-5003161de849 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:50.482569 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7e19be2a-65c2-41f2-a03a-5003161de849 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:50.489234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7e19be2a-65c2-41f2-a03a-5003161de849 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:50.489673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7e19be2a-65c2-41f2-a03a-5003161de849 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:50.490616 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7e19be2a-65c2-41f2-a03a-5003161de849 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:50.490859 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7e19be2a-65c2-41f2-a03a-5003161de849 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:50.631416 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7e19be2a-65c2-41f2-a03a-5003161de849 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:50.638747 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7e19be2a-65c2-41f2-a03a-5003161de849 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.163492 Jun 16 11:56:50.639306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 59/112] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:50 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:50.944788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7313fa37-a7f8-4820-a160-928ad915e63b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:50.945443 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7313fa37-a7f8-4820-a160-928ad915e63b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:50.951965 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7313fa37-a7f8-4820-a160-928ad915e63b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:50.952524 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7313fa37-a7f8-4820-a160-928ad915e63b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:50.953359 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7313fa37-a7f8-4820-a160-928ad915e63b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:50.953860 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7313fa37-a7f8-4820-a160-928ad915e63b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:51.010430 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-eaec30b2-08c7-44c1-bf5c-44c2a5d77862 req-660d8c6a-8ba5-4fa1-9715-2a49f259b8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6646f09a-70e9-487b-98f0-89ab1fe5508a", "name": "network-vif-plugged", "status": "completed", "tag": "e8a94066-1a49-45d0-9264-0c1a6dbdacde"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:51.018697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-eaec30b2-08c7-44c1-bf5c-44c2a5d77862 req-660d8c6a-8ba5-4fa1-9715-2a49f259b8ea service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:51.019184 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-eaec30b2-08c7-44c1-bf5c-44c2a5d77862 req-660d8c6a-8ba5-4fa1-9715-2a49f259b8ea service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:51.031663 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-eaec30b2-08c7-44c1-bf5c-44c2a5d77862 req-660d8c6a-8ba5-4fa1-9715-2a49f259b8ea service nova] Creating event network-vif-plugged:e8a94066-1a49-45d0-9264-0c1a6dbdacde for instance 6646f09a-70e9-487b-98f0-89ab1fe5508a on hv-cinder-84614 Jun 16 11:56:51.036833 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-eaec30b2-08c7-44c1-bf5c-44c2a5d77862 req-660d8c6a-8ba5-4fa1-9715-2a49f259b8ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 Jun 16 11:56:51.037487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 60/113] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:56:51.043112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:51.044610 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:51.051032 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:51.054116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:51.054116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:51.054116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:51.103726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7313fa37-a7f8-4820-a160-928ad915e63b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:51.112328 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7313fa37-a7f8-4820-a160-928ad915e63b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.171227 Jun 16 11:56:51.113177 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 54/114] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:50 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:51.126318 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2b5d232d-0f43-4515-bcfb-3393cbf6a4fc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:51.127550 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2b5d232d-0f43-4515-bcfb-3393cbf6a4fc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:51.135734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2b5d232d-0f43-4515-bcfb-3393cbf6a4fc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:51.136222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2b5d232d-0f43-4515-bcfb-3393cbf6a4fc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:51.137006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2b5d232d-0f43-4515-bcfb-3393cbf6a4fc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:51.137639 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2b5d232d-0f43-4515-bcfb-3393cbf6a4fc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:51.202323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:51.210498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:51.212021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:51.214773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8cd18682-d9a1-4a6e-9f1f-dc7762e90273 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.174163 Jun 16 11:56:51.214773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 61/115] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:51 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:51.281361 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2b5d232d-0f43-4515-bcfb-3393cbf6a4fc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:51.293466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2b5d232d-0f43-4515-bcfb-3393cbf6a4fc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.174619 Jun 16 11:56:51.293466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 55/116] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:51 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:51.655034 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b9108a2f-7797-4f85-b2df-6c2a5241a3ea tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:51.655967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b9108a2f-7797-4f85-b2df-6c2a5241a3ea tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:51.662597 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b9108a2f-7797-4f85-b2df-6c2a5241a3ea tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:51.663106 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b9108a2f-7797-4f85-b2df-6c2a5241a3ea tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:51.668337 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b9108a2f-7797-4f85-b2df-6c2a5241a3ea tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:51.668337 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b9108a2f-7797-4f85-b2df-6c2a5241a3ea tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:51.813904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b9108a2f-7797-4f85-b2df-6c2a5241a3ea tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:51.821156 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b9108a2f-7797-4f85-b2df-6c2a5241a3ea tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.170169 Jun 16 11:56:51.821703 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 62/117] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:51 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:52.129009 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5d5ff1cf-d328-46f3-a862-888050463e78 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:52.130675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5d5ff1cf-d328-46f3-a862-888050463e78 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:52.136957 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d5ff1cf-d328-46f3-a862-888050463e78 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:52.137507 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d5ff1cf-d328-46f3-a862-888050463e78 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:52.138511 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d5ff1cf-d328-46f3-a862-888050463e78 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:52.139131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d5ff1cf-d328-46f3-a862-888050463e78 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:52.234778 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:52.235310 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:52.244091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:52.244630 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:52.245311 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:52.245745 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:52.314009 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5d5ff1cf-d328-46f3-a862-888050463e78 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:52.322505 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5d5ff1cf-d328-46f3-a862-888050463e78 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.197167 Jun 16 11:56:52.332017 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 56/118] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:52 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:52.337012 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d30f2a5b-616d-43d8-ba8c-3e8f433aa0fd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:52.337718 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d30f2a5b-616d-43d8-ba8c-3e8f433aa0fd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:52.345635 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d30f2a5b-616d-43d8-ba8c-3e8f433aa0fd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:52.346069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d30f2a5b-616d-43d8-ba8c-3e8f433aa0fd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:52.346826 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d30f2a5b-616d-43d8-ba8c-3e8f433aa0fd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:52.347265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d30f2a5b-616d-43d8-ba8c-3e8f433aa0fd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:52.404012 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:52.415024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:52.416870 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:52.418029 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-71f57987-8eb5-4a8b-aa23-2807cfcba798 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.189446 Jun 16 11:56:52.419807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 63/119] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:52 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:56:52.556154 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d30f2a5b-616d-43d8-ba8c-3e8f433aa0fd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:52.564947 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d30f2a5b-616d-43d8-ba8c-3e8f433aa0fd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.231565 Jun 16 11:56:52.568048 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 57/120] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:52 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:52.838586 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bc47c3ba-9cc4-4fee-a07d-424f7fc2c96d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:52.839180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bc47c3ba-9cc4-4fee-a07d-424f7fc2c96d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:52.849139 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bc47c3ba-9cc4-4fee-a07d-424f7fc2c96d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:52.849625 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bc47c3ba-9cc4-4fee-a07d-424f7fc2c96d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:52.850925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bc47c3ba-9cc4-4fee-a07d-424f7fc2c96d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:52.850925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bc47c3ba-9cc4-4fee-a07d-424f7fc2c96d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:52.990469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bc47c3ba-9cc4-4fee-a07d-424f7fc2c96d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:52.998116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bc47c3ba-9cc4-4fee-a07d-424f7fc2c96d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.163246 Jun 16 11:56:52.998615 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 64/121] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:52 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:53.051721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-a1b25434-6bde-4fd4-b2aa-aff01e7a0267 req-7b6d200c-8c0c-459d-94fd-82fcd9c4e02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd786b9e-48e7-4695-8549-aeabb6511e72", "name": "network-vif-plugged", "status": "completed", "tag": "ebc45963-7af0-458c-bad2-2f2724cd51e0"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:53.060142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-a1b25434-6bde-4fd4-b2aa-aff01e7a0267 req-7b6d200c-8c0c-459d-94fd-82fcd9c4e02c service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:53.060743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-a1b25434-6bde-4fd4-b2aa-aff01e7a0267 req-7b6d200c-8c0c-459d-94fd-82fcd9c4e02c service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:53.083853 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-a1b25434-6bde-4fd4-b2aa-aff01e7a0267 req-7b6d200c-8c0c-459d-94fd-82fcd9c4e02c service nova] Creating event network-vif-plugged:ebc45963-7af0-458c-bad2-2f2724cd51e0 for instance bd786b9e-48e7-4695-8549-aeabb6511e72 on hv-cinder-84614 Jun 16 11:56:53.094370 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-a1b25434-6bde-4fd4-b2aa-aff01e7a0267 req-7b6d200c-8c0c-459d-94fd-82fcd9c4e02c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046204 Jun 16 11:56:53.104926 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 58/122] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:53.338486 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-111cf4a5-9264-4ef4-bd4f-f3f396281130 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:53.339097 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-111cf4a5-9264-4ef4-bd4f-f3f396281130 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:53.348231 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-111cf4a5-9264-4ef4-bd4f-f3f396281130 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:53.348771 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-111cf4a5-9264-4ef4-bd4f-f3f396281130 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:53.349573 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-111cf4a5-9264-4ef4-bd4f-f3f396281130 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:53.350005 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-111cf4a5-9264-4ef4-bd4f-f3f396281130 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:53.437436 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:53.438202 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:53.444518 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:53.444967 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:53.445727 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:53.446162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:53.493384 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-111cf4a5-9264-4ef4-bd4f-f3f396281130 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:53.503024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-111cf4a5-9264-4ef4-bd4f-f3f396281130 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.167746 Jun 16 11:56:53.503579 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 65/123] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:53 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:53.581387 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e6e8bfce-baa6-4689-a07e-e83562971a62 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:53.581950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:53.582377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e6e8bfce-baa6-4689-a07e-e83562971a62 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:53.588407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6e8bfce-baa6-4689-a07e-e83562971a62 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:53.588841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6e8bfce-baa6-4689-a07e-e83562971a62 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:53.589585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6e8bfce-baa6-4689-a07e-e83562971a62 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:53.589829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:53.590008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6e8bfce-baa6-4689-a07e-e83562971a62 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:53.591379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:53.592505 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-db331ae0-91b4-4018-ad03-71a40505345f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.160008 Jun 16 11:56:53.598948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 59/124] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:53 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:56:53.599065 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:53.727434 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e6e8bfce-baa6-4689-a07e-e83562971a62 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:53.735248 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e6e8bfce-baa6-4689-a07e-e83562971a62 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.157743 Jun 16 11:56:53.735803 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 66/125] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:53 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:54.014873 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e0a2ebd5-9f2b-45aa-a82b-0d11d90123f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:54.015542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e0a2ebd5-9f2b-45aa-a82b-0d11d90123f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:54.021534 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e0a2ebd5-9f2b-45aa-a82b-0d11d90123f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:54.021978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e0a2ebd5-9f2b-45aa-a82b-0d11d90123f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:54.022729 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e0a2ebd5-9f2b-45aa-a82b-0d11d90123f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:54.023157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e0a2ebd5-9f2b-45aa-a82b-0d11d90123f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:54.148810 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e0a2ebd5-9f2b-45aa-a82b-0d11d90123f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:54.156873 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e0a2ebd5-9f2b-45aa-a82b-0d11d90123f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.145843 Jun 16 11:56:54.157436 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 60/126] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:54 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:54.520703 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-980a9abe-2e34-40c1-85ce-239e404945d0 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:54.521308 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-980a9abe-2e34-40c1-85ce-239e404945d0 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:54.527375 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-980a9abe-2e34-40c1-85ce-239e404945d0 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:54.528477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-980a9abe-2e34-40c1-85ce-239e404945d0 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:54.529242 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-980a9abe-2e34-40c1-85ce-239e404945d0 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:54.529672 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-980a9abe-2e34-40c1-85ce-239e404945d0 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:54.614242 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:54.615131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:54.624986 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:54.625711 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:54.626631 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:54.627215 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:54.689601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-980a9abe-2e34-40c1-85ce-239e404945d0 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:54.697959 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-980a9abe-2e34-40c1-85ce-239e404945d0 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.182648 Jun 16 11:56:54.699283 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 67/127] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:54 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:54.752375 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-472b27ff-fe55-44ab-84bc-bb028d5079df tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:54.753129 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-472b27ff-fe55-44ab-84bc-bb028d5079df tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:54.759093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-472b27ff-fe55-44ab-84bc-bb028d5079df tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:54.759609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-472b27ff-fe55-44ab-84bc-bb028d5079df tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:54.760459 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-472b27ff-fe55-44ab-84bc-bb028d5079df tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:54.760959 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-472b27ff-fe55-44ab-84bc-bb028d5079df tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:54.777216 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:54.786143 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:54.787975 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:54.789204 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f9f73d55-b68f-4c05-9173-39437856494e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.182154 Jun 16 11:56:54.799431 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 61/128] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:54 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:54.890054 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-472b27ff-fe55-44ab-84bc-bb028d5079df tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:54.897378 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-472b27ff-fe55-44ab-84bc-bb028d5079df tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.148945 Jun 16 11:56:54.898724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 68/129] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:54 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:55.174162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-54d66243-11e5-4f69-90be-71d96ddd2bab tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:55.174790 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-54d66243-11e5-4f69-90be-71d96ddd2bab tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:55.181138 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54d66243-11e5-4f69-90be-71d96ddd2bab tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:55.181600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54d66243-11e5-4f69-90be-71d96ddd2bab tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:55.182411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54d66243-11e5-4f69-90be-71d96ddd2bab tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:55.182838 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54d66243-11e5-4f69-90be-71d96ddd2bab tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:55.326515 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-54d66243-11e5-4f69-90be-71d96ddd2bab tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:55.334425 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-54d66243-11e5-4f69-90be-71d96ddd2bab tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.164058 Jun 16 11:56:55.341068 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 62/130] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:55 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:55.716319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ebff29a7-2838-4ae7-ac1b-211f14f29983 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:55.716943 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ebff29a7-2838-4ae7-ac1b-211f14f29983 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:55.723181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebff29a7-2838-4ae7-ac1b-211f14f29983 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:55.723613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebff29a7-2838-4ae7-ac1b-211f14f29983 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:55.724378 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebff29a7-2838-4ae7-ac1b-211f14f29983 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:55.724800 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebff29a7-2838-4ae7-ac1b-211f14f29983 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:55.806392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:55.806988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:55.813281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:55.813742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:55.814474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:55.814897 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:55.860775 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ebff29a7-2838-4ae7-ac1b-211f14f29983 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:55.868100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ebff29a7-2838-4ae7-ac1b-211f14f29983 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.156176 Jun 16 11:56:55.868601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 69/131] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:55 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:55.914058 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b64bf038-2a16-4d08-b37b-7c19224d51d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:55.914674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b64bf038-2a16-4d08-b37b-7c19224d51d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:55.920824 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b64bf038-2a16-4d08-b37b-7c19224d51d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:55.921262 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b64bf038-2a16-4d08-b37b-7c19224d51d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:55.922019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b64bf038-2a16-4d08-b37b-7c19224d51d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:55.922452 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b64bf038-2a16-4d08-b37b-7c19224d51d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:55.945321 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:55.953802 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:55.955327 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:55.956435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e9cc0706-992a-4b9c-93b2-9ee5ec98f3f3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1407 microversion: 2.20 time: 0.153919 Jun 16 11:56:55.956996 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 63/132] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:55 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:56:56.050790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b64bf038-2a16-4d08-b37b-7c19224d51d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:56.058803 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b64bf038-2a16-4d08-b37b-7c19224d51d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.148597 Jun 16 11:56:56.059594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 70/133] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:55 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:56:56.351893 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7660f423-0ab1-479e-8edb-0881df83dec1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:56.352604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7660f423-0ab1-479e-8edb-0881df83dec1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:56.358630 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7660f423-0ab1-479e-8edb-0881df83dec1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:56.359067 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7660f423-0ab1-479e-8edb-0881df83dec1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:56.359814 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7660f423-0ab1-479e-8edb-0881df83dec1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:56.360258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7660f423-0ab1-479e-8edb-0881df83dec1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:56.494396 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7660f423-0ab1-479e-8edb-0881df83dec1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:56.502584 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7660f423-0ab1-479e-8edb-0881df83dec1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.154574 Jun 16 11:56:56.503152 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 64/134] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:56 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:56.884824 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0cf38e05-fda8-412a-bffb-1ca2f6ca5643 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:56.885553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0cf38e05-fda8-412a-bffb-1ca2f6ca5643 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:56.892662 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0cf38e05-fda8-412a-bffb-1ca2f6ca5643 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:56.893104 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0cf38e05-fda8-412a-bffb-1ca2f6ca5643 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:56.893867 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0cf38e05-fda8-412a-bffb-1ca2f6ca5643 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:56.894403 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0cf38e05-fda8-412a-bffb-1ca2f6ca5643 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:56.974644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:56.975247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:56.989812 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:56.990326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:56.991173 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:56.991670 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:57.008174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=100 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:57.030973 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0cf38e05-fda8-412a-bffb-1ca2f6ca5643 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:57.039033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0cf38e05-fda8-412a-bffb-1ca2f6ca5643 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.158081 Jun 16 11:56:57.040089 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 71/135] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:56 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:57.074413 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d2af879e-3791-4197-99a0-5f90a2b79ef1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:57.075245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d2af879e-3791-4197-99a0-5f90a2b79ef1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:57.081772 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2af879e-3791-4197-99a0-5f90a2b79ef1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:57.082214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2af879e-3791-4197-99a0-5f90a2b79ef1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:57.083109 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2af879e-3791-4197-99a0-5f90a2b79ef1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:57.083540 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2af879e-3791-4197-99a0-5f90a2b79ef1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:57.132897 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:57.140971 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:57.142465 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:57.143606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c0f9b7ef-b053-44ad-9ad9-bd62c2c6aaf2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1598 microversion: 2.20 time: 0.172821 Jun 16 11:56:57.144197 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 65/136] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:56:56 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:56:57.162470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-46917917-9e94-4f60-aef5-7df4aeac7b5c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:57.164531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-46917917-9e94-4f60-aef5-7df4aeac7b5c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:57.171779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-46917917-9e94-4f60-aef5-7df4aeac7b5c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:57.172217 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-46917917-9e94-4f60-aef5-7df4aeac7b5c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:57.172983 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-46917917-9e94-4f60-aef5-7df4aeac7b5c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:57.173415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-46917917-9e94-4f60-aef5-7df4aeac7b5c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:57.222472 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d2af879e-3791-4197-99a0-5f90a2b79ef1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:57.230437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d2af879e-3791-4197-99a0-5f90a2b79ef1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.159770 Jun 16 11:56:57.231825 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 72/137] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:57 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:57.295797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-46917917-9e94-4f60-aef5-7df4aeac7b5c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.137235 Jun 16 11:56:57.296411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 66/138] 10.222.0.40 () {60 vars in 1315 bytes} [Thu Jun 16 11:56:57 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 11:56:57.519113 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4cab1235-2bdc-4e99-8c15-df4c828f991c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:57.519716 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4cab1235-2bdc-4e99-8c15-df4c828f991c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:57.525958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cab1235-2bdc-4e99-8c15-df4c828f991c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:57.526599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cab1235-2bdc-4e99-8c15-df4c828f991c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:57.528306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cab1235-2bdc-4e99-8c15-df4c828f991c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:57.528898 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cab1235-2bdc-4e99-8c15-df4c828f991c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:58.049809 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4cab1235-2bdc-4e99-8c15-df4c828f991c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:58.059739 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4cab1235-2bdc-4e99-8c15-df4c828f991c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.543744 Jun 16 11:56:58.060519 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 73/139] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:57 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:58.061538 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a351cb5c-8fb6-456b-ad40-e56aba849d7d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:58.062669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a351cb5c-8fb6-456b-ad40-e56aba849d7d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:58.070098 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a351cb5c-8fb6-456b-ad40-e56aba849d7d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:58.070699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a351cb5c-8fb6-456b-ad40-e56aba849d7d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:58.071593 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a351cb5c-8fb6-456b-ad40-e56aba849d7d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:58.072084 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a351cb5c-8fb6-456b-ad40-e56aba849d7d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:58.247182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3b485b0f-7b58-498d-b446-91d6ee2db159 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:58.247811 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3b485b0f-7b58-498d-b446-91d6ee2db159 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:58.253761 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b485b0f-7b58-498d-b446-91d6ee2db159 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:58.254195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b485b0f-7b58-498d-b446-91d6ee2db159 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:58.254945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b485b0f-7b58-498d-b446-91d6ee2db159 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:58.255449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b485b0f-7b58-498d-b446-91d6ee2db159 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:58.257802 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a351cb5c-8fb6-456b-ad40-e56aba849d7d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:58.265735 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a351cb5c-8fb6-456b-ad40-e56aba849d7d tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.211276 Jun 16 11:56:58.270199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 67/140] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:58 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:58.467577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3b485b0f-7b58-498d-b446-91d6ee2db159 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:58.475609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3b485b0f-7b58-498d-b446-91d6ee2db159 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.232465 Jun 16 11:56:58.476313 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 74/141] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:58 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:58.807188 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-d6aeaa1a-b6c0-4edc-aa40-ecfeab711150 req-b7cef4fd-0111-4b52-9cac-d0bfb1d92407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6646f09a-70e9-487b-98f0-89ab1fe5508a", "tag": "e8a94066-1a49-45d0-9264-0c1a6dbdacde"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:56:58.816332 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-d6aeaa1a-b6c0-4edc-aa40-ecfeab711150 req-b7cef4fd-0111-4b52-9cac-d0bfb1d92407 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:58.816808 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-d6aeaa1a-b6c0-4edc-aa40-ecfeab711150 req-b7cef4fd-0111-4b52-9cac-d0bfb1d92407 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:58.829283 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-d6aeaa1a-b6c0-4edc-aa40-ecfeab711150 req-b7cef4fd-0111-4b52-9cac-d0bfb1d92407 service nova] Creating event network-changed:e8a94066-1a49-45d0-9264-0c1a6dbdacde for instance 6646f09a-70e9-487b-98f0-89ab1fe5508a on hv-cinder-84614 Jun 16 11:56:58.834749 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-d6aeaa1a-b6c0-4edc-aa40-ecfeab711150 req-b7cef4fd-0111-4b52-9cac-d0bfb1d92407 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031350 Jun 16 11:56:58.835550 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 68/142] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:56:59.076726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4fd6ef4d-11ad-45d8-a190-ad1457d3beb8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:59.077953 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4fd6ef4d-11ad-45d8-a190-ad1457d3beb8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:59.084564 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4fd6ef4d-11ad-45d8-a190-ad1457d3beb8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:59.085273 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4fd6ef4d-11ad-45d8-a190-ad1457d3beb8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:59.086046 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4fd6ef4d-11ad-45d8-a190-ad1457d3beb8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:59.086476 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4fd6ef4d-11ad-45d8-a190-ad1457d3beb8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:59.245088 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4fd6ef4d-11ad-45d8-a190-ad1457d3beb8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:59.252804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4fd6ef4d-11ad-45d8-a190-ad1457d3beb8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.180104 Jun 16 11:56:59.254030 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 75/143] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:59 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:59.283703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b1ebef40-1c13-4d24-a48c-91f4c8f2036b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:59.284586 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b1ebef40-1c13-4d24-a48c-91f4c8f2036b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:59.291102 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1ebef40-1c13-4d24-a48c-91f4c8f2036b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:59.291545 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1ebef40-1c13-4d24-a48c-91f4c8f2036b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:59.292353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1ebef40-1c13-4d24-a48c-91f4c8f2036b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:59.292788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1ebef40-1c13-4d24-a48c-91f4c8f2036b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:59.493164 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d4b4b974-e804-4aad-985a-175eeb21c581 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:56:59.493773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d4b4b974-e804-4aad-985a-175eeb21c581 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:56:59.500415 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d4b4b974-e804-4aad-985a-175eeb21c581 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:59.500856 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d4b4b974-e804-4aad-985a-175eeb21c581 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:59.501849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d4b4b974-e804-4aad-985a-175eeb21c581 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:56:59.502474 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d4b4b974-e804-4aad-985a-175eeb21c581 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:56:59.562716 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b1ebef40-1c13-4d24-a48c-91f4c8f2036b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:59.570725 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b1ebef40-1c13-4d24-a48c-91f4c8f2036b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1315 microversion: 2.1 time: 0.291195 Jun 16 11:56:59.571513 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 69/144] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:59 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:56:59.693544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d4b4b974-e804-4aad-985a-175eeb21c581 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:56:59.703475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d4b4b974-e804-4aad-985a-175eeb21c581 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1322 microversion: 2.1 time: 0.213868 Jun 16 11:56:59.704220 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 76/145] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:56:59 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:00.273069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d132cb1a-0f9f-48fd-999a-8beccc14bbba tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:00.273807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d132cb1a-0f9f-48fd-999a-8beccc14bbba tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:00.329819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d132cb1a-0f9f-48fd-999a-8beccc14bbba tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:00.330468 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d132cb1a-0f9f-48fd-999a-8beccc14bbba tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:00.333661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d132cb1a-0f9f-48fd-999a-8beccc14bbba tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:00.344224 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d132cb1a-0f9f-48fd-999a-8beccc14bbba tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:00.587209 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-556adfc3-4147-4759-af3a-bef35e5c547b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:00.587987 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-556adfc3-4147-4759-af3a-bef35e5c547b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:00.594671 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-556adfc3-4147-4759-af3a-bef35e5c547b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:00.595108 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-556adfc3-4147-4759-af3a-bef35e5c547b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:00.596061 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-556adfc3-4147-4759-af3a-bef35e5c547b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:00.596650 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-556adfc3-4147-4759-af3a-bef35e5c547b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:00.609651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d132cb1a-0f9f-48fd-999a-8beccc14bbba tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:00.618134 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d132cb1a-0f9f-48fd-999a-8beccc14bbba tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.351418 Jun 16 11:57:00.618706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 70/146] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:00 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:00.722428 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6b90f194-e9b7-451a-b4a3-c5d474d253cf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:00.723128 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6b90f194-e9b7-451a-b4a3-c5d474d253cf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:00.731432 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6b90f194-e9b7-451a-b4a3-c5d474d253cf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:00.731906 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6b90f194-e9b7-451a-b4a3-c5d474d253cf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:00.732827 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6b90f194-e9b7-451a-b4a3-c5d474d253cf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:00.733258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6b90f194-e9b7-451a-b4a3-c5d474d253cf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:00.789570 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-556adfc3-4147-4759-af3a-bef35e5c547b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:00.798116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-556adfc3-4147-4759-af3a-bef35e5c547b tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1502 microversion: 2.1 time: 0.214570 Jun 16 11:57:00.798730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 77/147] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:00 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:01.190222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6b90f194-e9b7-451a-b4a3-c5d474d253cf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:01.201997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6b90f194-e9b7-451a-b4a3-c5d474d253cf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1516 microversion: 2.1 time: 0.483867 Jun 16 11:57:01.202925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 71/148] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:00 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1516 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:01.222319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a94b1094-f9c6-43d7-bfcb-071908a1518e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:01.223964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a94b1094-f9c6-43d7-bfcb-071908a1518e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:01.242127 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a94b1094-f9c6-43d7-bfcb-071908a1518e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:01.242582 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a94b1094-f9c6-43d7-bfcb-071908a1518e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:01.243377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a94b1094-f9c6-43d7-bfcb-071908a1518e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:01.243814 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a94b1094-f9c6-43d7-bfcb-071908a1518e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:01.347274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-a94b1094-f9c6-43d7-bfcb-071908a1518e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'flavor' on Instance uuid a0cfe043-70c3-4137-b979-cfab2e3c1bab {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:57:01.635675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0675d19c-2201-485b-a274-876479cd37ca tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:01.636262 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0675d19c-2201-485b-a274-876479cd37ca tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:01.642787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0675d19c-2201-485b-a274-876479cd37ca tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:01.643224 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0675d19c-2201-485b-a274-876479cd37ca tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:01.645094 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0675d19c-2201-485b-a274-876479cd37ca tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:01.646856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0675d19c-2201-485b-a274-876479cd37ca tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:01.759918 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a94b1094-f9c6-43d7-bfcb-071908a1518e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab/action" status: 200 len: 32 microversion: 2.1 time: 0.539990 Jun 16 11:57:01.759918 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 78/149] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:57:01 2022] POST /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab/action => generated 32 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 11:57:01.769374 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-22e15fc7-2e9d-44f8-8961-501271f6232f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:01.770873 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-22e15fc7-2e9d-44f8-8961-501271f6232f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:01.789502 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-22e15fc7-2e9d-44f8-8961-501271f6232f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:01.792633 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-22e15fc7-2e9d-44f8-8961-501271f6232f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:01.793658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-22e15fc7-2e9d-44f8-8961-501271f6232f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:01.795546 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-22e15fc7-2e9d-44f8-8961-501271f6232f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:01.974323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-22e15fc7-2e9d-44f8-8961-501271f6232f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:01.984129 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-22e15fc7-2e9d-44f8-8961-501271f6232f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.219668 Jun 16 11:57:01.988736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 79/150] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:01 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:02.041736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0675d19c-2201-485b-a274-876479cd37ca tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:02.055363 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0675d19c-2201-485b-a274-876479cd37ca tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.424366 Jun 16 11:57:02.070013 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 72/151] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:01 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:03.003376 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b2921115-c10f-4a4c-a6b6-4aeac929d539 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:03.004249 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b2921115-c10f-4a4c-a6b6-4aeac929d539 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:03.015804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b2921115-c10f-4a4c-a6b6-4aeac929d539 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:03.016394 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b2921115-c10f-4a4c-a6b6-4aeac929d539 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:03.017396 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b2921115-c10f-4a4c-a6b6-4aeac929d539 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:03.018921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b2921115-c10f-4a4c-a6b6-4aeac929d539 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:03.081066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8e2d2cda-f9d3-433b-88de-180a1f2d9cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:03.082315 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8e2d2cda-f9d3-433b-88de-180a1f2d9cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:03.100146 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8e2d2cda-f9d3-433b-88de-180a1f2d9cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:03.100712 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8e2d2cda-f9d3-433b-88de-180a1f2d9cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:03.101679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8e2d2cda-f9d3-433b-88de-180a1f2d9cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:03.102207 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8e2d2cda-f9d3-433b-88de-180a1f2d9cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:03.302507 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8e2d2cda-f9d3-433b-88de-180a1f2d9cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:03.311165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8e2d2cda-f9d3-433b-88de-180a1f2d9cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.240031 Jun 16 11:57:03.324347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 73/152] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:03 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:03.330273 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-13599e2f-9ef8-49c8-882c-657b38282357 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "028d001d-a1b1-47c0-9a32-4788ecb8b6b8"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:03.331421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-13599e2f-9ef8-49c8-882c-657b38282357 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:03.346807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13599e2f-9ef8-49c8-882c-657b38282357 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:03.346807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13599e2f-9ef8-49c8-882c-657b38282357 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:03.346807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13599e2f-9ef8-49c8-882c-657b38282357 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:03.346807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13599e2f-9ef8-49c8-882c-657b38282357 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:03.384564 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b2921115-c10f-4a4c-a6b6-4aeac929d539 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:03.388497 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:03.393247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b2921115-c10f-4a4c-a6b6-4aeac929d539 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.394646 Jun 16 11:57:03.394063 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 80/153] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:02 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:04.329137 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a2e6cf43-cf6e-47b8-9d83-812a009e49f4 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:04.330565 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a2e6cf43-cf6e-47b8-9d83-812a009e49f4 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:04.343192 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a2e6cf43-cf6e-47b8-9d83-812a009e49f4 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:04.345189 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a2e6cf43-cf6e-47b8-9d83-812a009e49f4 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:04.346207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a2e6cf43-cf6e-47b8-9d83-812a009e49f4 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:04.346799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a2e6cf43-cf6e-47b8-9d83-812a009e49f4 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:04.685918 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a2e6cf43-cf6e-47b8-9d83-812a009e49f4 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:04.695046 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a2e6cf43-cf6e-47b8-9d83-812a009e49f4 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.370495 Jun 16 11:57:04.698108 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 81/154] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:04 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:04.710487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fa1e51fd-cc41-4e91-a873-61d44a9a94a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:04.711105 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-fa1e51fd-cc41-4e91-a873-61d44a9a94a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:04.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fa1e51fd-cc41-4e91-a873-61d44a9a94a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:04.719850 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fa1e51fd-cc41-4e91-a873-61d44a9a94a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:04.720693 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fa1e51fd-cc41-4e91-a873-61d44a9a94a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:04.721136 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fa1e51fd-cc41-4e91-a873-61d44a9a94a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:04.895627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-fa1e51fd-cc41-4e91-a873-61d44a9a94a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:04.904130 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-fa1e51fd-cc41-4e91-a873-61d44a9a94a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.201559 Jun 16 11:57:04.905204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 82/155] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:04 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:05.715471 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9abf0489-e8ba-4f31-b61f-9bb1e1a3a117 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:05.716103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9abf0489-e8ba-4f31-b61f-9bb1e1a3a117 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:05.723039 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9abf0489-e8ba-4f31-b61f-9bb1e1a3a117 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:05.723667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9abf0489-e8ba-4f31-b61f-9bb1e1a3a117 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:05.724654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9abf0489-e8ba-4f31-b61f-9bb1e1a3a117 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:05.725225 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9abf0489-e8ba-4f31-b61f-9bb1e1a3a117 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:05.908343 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9abf0489-e8ba-4f31-b61f-9bb1e1a3a117 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:05.915614 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9abf0489-e8ba-4f31-b61f-9bb1e1a3a117 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1364 microversion: 2.1 time: 0.204943 Jun 16 11:57:05.916915 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 83/156] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:05 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:05.922214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f3e623d4-8ed1-4277-906d-71e043ba0475 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:05.922972 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f3e623d4-8ed1-4277-906d-71e043ba0475 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:05.930276 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f3e623d4-8ed1-4277-906d-71e043ba0475 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:05.930584 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f3e623d4-8ed1-4277-906d-71e043ba0475 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:05.931501 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f3e623d4-8ed1-4277-906d-71e043ba0475 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:05.932226 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f3e623d4-8ed1-4277-906d-71e043ba0475 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:06.096541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f3e623d4-8ed1-4277-906d-71e043ba0475 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:06.110088 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f3e623d4-8ed1-4277-906d-71e043ba0475 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.191213 Jun 16 11:57:06.111104 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 84/157] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:05 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:06.940738 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-07f87463-c844-4325-a3dc-10e848fe24f5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:06.941997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-07f87463-c844-4325-a3dc-10e848fe24f5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:06.949928 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-07f87463-c844-4325-a3dc-10e848fe24f5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:06.950318 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-07f87463-c844-4325-a3dc-10e848fe24f5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:06.951357 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-07f87463-c844-4325-a3dc-10e848fe24f5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:06.951978 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-07f87463-c844-4325-a3dc-10e848fe24f5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:07.269200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-07f87463-c844-4325-a3dc-10e848fe24f5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:07.283372 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-07f87463-c844-4325-a3dc-10e848fe24f5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1551 microversion: 2.1 time: 0.348078 Jun 16 11:57:07.289204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 85/158] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:06 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1551 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:07.302907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ccd0f697-6c40-4577-80f2-72bff4324010 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:07.303802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ccd0f697-6c40-4577-80f2-72bff4324010 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:07.311423 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:07.313449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ccd0f697-6c40-4577-80f2-72bff4324010 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:07.317705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ccd0f697-6c40-4577-80f2-72bff4324010 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:07.317705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ccd0f697-6c40-4577-80f2-72bff4324010 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:07.317705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ccd0f697-6c40-4577-80f2-72bff4324010 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:07.386149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-13599e2f-9ef8-49c8-882c-657b38282357 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "POST /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.059591 Jun 16 11:57:07.386859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 74/159] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 11:57:03 2022] POST /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c/os-volume_attachments => generated 194 bytes in 4062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:57:07.396609 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b2b29b22-6b70-4f2d-ab3c-96101ed9184e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:07.397968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b2b29b22-6b70-4f2d-ab3c-96101ed9184e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:07.413943 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=95 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:07.418389 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b2b29b22-6b70-4f2d-ab3c-96101ed9184e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:07.419801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b2b29b22-6b70-4f2d-ab3c-96101ed9184e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:07.423129 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b2b29b22-6b70-4f2d-ab3c-96101ed9184e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:07.424799 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b2b29b22-6b70-4f2d-ab3c-96101ed9184e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:07.579853 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ccd0f697-6c40-4577-80f2-72bff4324010 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:07.593591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ccd0f697-6c40-4577-80f2-72bff4324010 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.305983 Jun 16 11:57:07.601095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 86/160] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:07 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:07.715539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b2b29b22-6b70-4f2d-ab3c-96101ed9184e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.326588 Jun 16 11:57:07.716471 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 75/161] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 11:57:07 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/os-interface => generated 285 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:57:08.614840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-50eec6fa-a1e5-4156-b480-74c507f6b914 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:08.615525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-50eec6fa-a1e5-4156-b480-74c507f6b914 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:08.622025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50eec6fa-a1e5-4156-b480-74c507f6b914 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:08.632063 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50eec6fa-a1e5-4156-b480-74c507f6b914 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:08.636886 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50eec6fa-a1e5-4156-b480-74c507f6b914 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:08.636886 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50eec6fa-a1e5-4156-b480-74c507f6b914 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:09.080164 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-50eec6fa-a1e5-4156-b480-74c507f6b914 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:09.088727 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-50eec6fa-a1e5-4156-b480-74c507f6b914 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.477727 Jun 16 11:57:09.102024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 87/162] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:08 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:09.699259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-dcc6a6ec-87ee-45ee-b0c5-28add47255ac req-49d9a8d5-d585-43d6-ba57-cbcb6dda38a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd786b9e-48e7-4695-8549-aeabb6511e72", "tag": "ebc45963-7af0-458c-bad2-2f2724cd51e0"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:09.699259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-dcc6a6ec-87ee-45ee-b0c5-28add47255ac req-49d9a8d5-d585-43d6-ba57-cbcb6dda38a9 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:09.699259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-dcc6a6ec-87ee-45ee-b0c5-28add47255ac req-49d9a8d5-d585-43d6-ba57-cbcb6dda38a9 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:09.699259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-dcc6a6ec-87ee-45ee-b0c5-28add47255ac req-49d9a8d5-d585-43d6-ba57-cbcb6dda38a9 service nova] Creating event network-changed:ebc45963-7af0-458c-bad2-2f2724cd51e0 for instance bd786b9e-48e7-4695-8549-aeabb6511e72 on hv-cinder-84614 Jun 16 11:57:09.700960 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-dcc6a6ec-87ee-45ee-b0c5-28add47255ac req-49d9a8d5-d585-43d6-ba57-cbcb6dda38a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036862 Jun 16 11:57:09.700960 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 76/163] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:57:10.109684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7cd755e4-84a2-4b7e-8ae8-0ffa50c10ead tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:10.110449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7cd755e4-84a2-4b7e-8ae8-0ffa50c10ead tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:10.117484 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cd755e4-84a2-4b7e-8ae8-0ffa50c10ead tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:10.117924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cd755e4-84a2-4b7e-8ae8-0ffa50c10ead tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:10.118688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cd755e4-84a2-4b7e-8ae8-0ffa50c10ead tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:10.119116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cd755e4-84a2-4b7e-8ae8-0ffa50c10ead tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:10.315735 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7cd755e4-84a2-4b7e-8ae8-0ffa50c10ead tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:10.324932 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7cd755e4-84a2-4b7e-8ae8-0ffa50c10ead tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.219874 Jun 16 11:57:10.325505 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 88/164] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:10 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:11.345545 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8222176c-e175-4c35-be16-cf5405fcccf1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:11.346991 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8222176c-e175-4c35-be16-cf5405fcccf1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:11.353293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8222176c-e175-4c35-be16-cf5405fcccf1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:11.353730 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8222176c-e175-4c35-be16-cf5405fcccf1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:11.354495 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8222176c-e175-4c35-be16-cf5405fcccf1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:11.354920 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8222176c-e175-4c35-be16-cf5405fcccf1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:11.599188 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8222176c-e175-4c35-be16-cf5405fcccf1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:11.613033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8222176c-e175-4c35-be16-cf5405fcccf1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.275048 Jun 16 11:57:11.614870 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 77/165] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:11 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:12.633484 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7bce8235-5e41-48a3-a689-b318d9f381fe tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:12.634902 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7bce8235-5e41-48a3-a689-b318d9f381fe tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:12.643572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7bce8235-5e41-48a3-a689-b318d9f381fe tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:12.644308 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7bce8235-5e41-48a3-a689-b318d9f381fe tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:12.645326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7bce8235-5e41-48a3-a689-b318d9f381fe tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:12.646159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7bce8235-5e41-48a3-a689-b318d9f381fe tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:12.830702 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7bce8235-5e41-48a3-a689-b318d9f381fe tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:12.838903 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7bce8235-5e41-48a3-a689-b318d9f381fe tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.212250 Jun 16 11:57:12.839821 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 89/166] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:12 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:13.862293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7a729380-789a-4eaa-ac1e-f77692ee75c3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:13.863551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7a729380-789a-4eaa-ac1e-f77692ee75c3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:13.882152 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7a729380-789a-4eaa-ac1e-f77692ee75c3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:13.882869 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7a729380-789a-4eaa-ac1e-f77692ee75c3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:13.884026 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7a729380-789a-4eaa-ac1e-f77692ee75c3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:13.884604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7a729380-789a-4eaa-ac1e-f77692ee75c3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:14.118669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7a729380-789a-4eaa-ac1e-f77692ee75c3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:14.130201 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7a729380-789a-4eaa-ac1e-f77692ee75c3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.277960 Jun 16 11:57:14.130788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 78/167] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:13 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:15.147828 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e7b687e4-9a99-4bcf-b6ab-c91f7e4ba0b0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:15.148525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e7b687e4-9a99-4bcf-b6ab-c91f7e4ba0b0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:15.158498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7b687e4-9a99-4bcf-b6ab-c91f7e4ba0b0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:15.159207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7b687e4-9a99-4bcf-b6ab-c91f7e4ba0b0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:15.160091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7b687e4-9a99-4bcf-b6ab-c91f7e4ba0b0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:15.160604 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7b687e4-9a99-4bcf-b6ab-c91f7e4ba0b0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:15.345397 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e7b687e4-9a99-4bcf-b6ab-c91f7e4ba0b0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:15.356737 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e7b687e4-9a99-4bcf-b6ab-c91f7e4ba0b0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.211426 Jun 16 11:57:15.357621 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 90/168] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:15 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:15.487778 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0270d459-828f-4690-9a1a-a721e57978de tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:15.488516 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0270d459-828f-4690-9a1a-a721e57978de tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:15.500408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0270d459-828f-4690-9a1a-a721e57978de tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:15.500408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0270d459-828f-4690-9a1a-a721e57978de tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:15.500408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0270d459-828f-4690-9a1a-a721e57978de tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:15.500408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0270d459-828f-4690-9a1a-a721e57978de tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:15.529451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0270d459-828f-4690-9a1a-a721e57978de tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Going to try to terminate instance {{(pid=125055) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 11:57:15.994807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0270d459-828f-4690-9a1a-a721e57978de tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "DELETE /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 204 len: 0 microversion: 2.1 time: 0.511315 Jun 16 11:57:15.995622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 79/169] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 11:57:15 2022] DELETE /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 11:57:16.005613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5dc9e90a-1dc2-442e-bc3e-ed55559af824 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:16.005613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5dc9e90a-1dc2-442e-bc3e-ed55559af824 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:16.010827 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5dc9e90a-1dc2-442e-bc3e-ed55559af824 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:16.012175 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5dc9e90a-1dc2-442e-bc3e-ed55559af824 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:16.013088 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5dc9e90a-1dc2-442e-bc3e-ed55559af824 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:16.013581 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5dc9e90a-1dc2-442e-bc3e-ed55559af824 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:16.167813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5dc9e90a-1dc2-442e-bc3e-ed55559af824 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:16.187878 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5dc9e90a-1dc2-442e-bc3e-ed55559af824 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1554 microversion: 2.1 time: 0.187759 Jun 16 11:57:16.188460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 91/170] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:15 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:16.380623 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-29ef8bd7-3763-4abd-9808-0d1498de3023 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:16.382301 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-29ef8bd7-3763-4abd-9808-0d1498de3023 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:16.398968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-29ef8bd7-3763-4abd-9808-0d1498de3023 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:16.402375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-29ef8bd7-3763-4abd-9808-0d1498de3023 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:16.402375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-29ef8bd7-3763-4abd-9808-0d1498de3023 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:16.402375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-29ef8bd7-3763-4abd-9808-0d1498de3023 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:16.638263 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-29ef8bd7-3763-4abd-9808-0d1498de3023 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:16.652510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-29ef8bd7-3763-4abd-9808-0d1498de3023 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.278333 Jun 16 11:57:16.654598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 80/171] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:16 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:17.209041 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-29b02b2f-1775-4aff-82b4-75ea2d2a789c tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:17.209799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-29b02b2f-1775-4aff-82b4-75ea2d2a789c tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:17.225251 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-29b02b2f-1775-4aff-82b4-75ea2d2a789c tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:17.231684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-29b02b2f-1775-4aff-82b4-75ea2d2a789c tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:17.231684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-29b02b2f-1775-4aff-82b4-75ea2d2a789c tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:17.231684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-29b02b2f-1775-4aff-82b4-75ea2d2a789c tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:17.452523 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-29b02b2f-1775-4aff-82b4-75ea2d2a789c tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:17.462381 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-29b02b2f-1775-4aff-82b4-75ea2d2a789c tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1554 microversion: 2.1 time: 0.255779 Jun 16 11:57:17.463555 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 92/172] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:17 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1554 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:17.673470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4167457c-fa0b-49bd-a0ee-74e482591a21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:17.674742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4167457c-fa0b-49bd-a0ee-74e482591a21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:17.694690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4167457c-fa0b-49bd-a0ee-74e482591a21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:17.695168 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4167457c-fa0b-49bd-a0ee-74e482591a21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:17.695988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4167457c-fa0b-49bd-a0ee-74e482591a21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:17.699645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4167457c-fa0b-49bd-a0ee-74e482591a21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:17.708439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:17.928785 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4167457c-fa0b-49bd-a0ee-74e482591a21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:17.938326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4167457c-fa0b-49bd-a0ee-74e482591a21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.270761 Jun 16 11:57:17.965334 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 81/173] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:17 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:18.482255 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9998f7ad-899c-4094-bb97-24fcbbc60bbd tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:18.482857 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9998f7ad-899c-4094-bb97-24fcbbc60bbd tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:18.500593 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9998f7ad-899c-4094-bb97-24fcbbc60bbd tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:18.501036 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9998f7ad-899c-4094-bb97-24fcbbc60bbd tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:18.501998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9998f7ad-899c-4094-bb97-24fcbbc60bbd tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:18.502462 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9998f7ad-899c-4094-bb97-24fcbbc60bbd tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:18.950432 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9998f7ad-899c-4094-bb97-24fcbbc60bbd tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:18.958933 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9998f7ad-899c-4094-bb97-24fcbbc60bbd tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1554 microversion: 2.1 time: 0.482628 Jun 16 11:57:18.959518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 93/174] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:18 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1554 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:18.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-058c41ca-3b5c-4e78-9832-3a4cafc889a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:18.962819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-058c41ca-3b5c-4e78-9832-3a4cafc889a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:18.972797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-058c41ca-3b5c-4e78-9832-3a4cafc889a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:18.973608 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-058c41ca-3b5c-4e78-9832-3a4cafc889a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:18.974911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-058c41ca-3b5c-4e78-9832-3a4cafc889a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:18.975513 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-058c41ca-3b5c-4e78-9832-3a4cafc889a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:19.169555 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-058c41ca-3b5c-4e78-9832-3a4cafc889a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:19.174130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-058c41ca-3b5c-4e78-9832-3a4cafc889a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.217161 Jun 16 11:57:19.174690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 82/175] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:18 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:19.977532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3250d2c8-7475-4ed6-927a-b1f0f6200ca2 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:19.978135 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3250d2c8-7475-4ed6-927a-b1f0f6200ca2 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:19.987239 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3250d2c8-7475-4ed6-927a-b1f0f6200ca2 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:19.987913 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3250d2c8-7475-4ed6-927a-b1f0f6200ca2 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:19.988900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3250d2c8-7475-4ed6-927a-b1f0f6200ca2 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:19.989527 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3250d2c8-7475-4ed6-927a-b1f0f6200ca2 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:20.192051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cf7a4a83-4a22-4181-b50c-319407701cd1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:20.195941 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-cf7a4a83-4a22-4181-b50c-319407701cd1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:20.212085 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cf7a4a83-4a22-4181-b50c-319407701cd1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:20.215398 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cf7a4a83-4a22-4181-b50c-319407701cd1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:20.216285 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cf7a4a83-4a22-4181-b50c-319407701cd1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:20.220575 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cf7a4a83-4a22-4181-b50c-319407701cd1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:20.306785 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3250d2c8-7475-4ed6-927a-b1f0f6200ca2 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:20.322753 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3250d2c8-7475-4ed6-927a-b1f0f6200ca2 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1554 microversion: 2.1 time: 0.349412 Jun 16 11:57:20.334131 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 94/176] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:19 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1554 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:20.466453 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-cf7a4a83-4a22-4181-b50c-319407701cd1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:20.478153 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-cf7a4a83-4a22-4181-b50c-319407701cd1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.290229 Jun 16 11:57:20.479237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 83/177] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:20 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:21.342459 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-818de7cb-e271-4c02-bd81-62e3e489df7a tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:21.343674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-818de7cb-e271-4c02-bd81-62e3e489df7a tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:21.354055 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-818de7cb-e271-4c02-bd81-62e3e489df7a tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:21.355517 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-818de7cb-e271-4c02-bd81-62e3e489df7a tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:21.356324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-818de7cb-e271-4c02-bd81-62e3e489df7a tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:21.356753 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-818de7cb-e271-4c02-bd81-62e3e489df7a tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:21.461326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-818de7cb-e271-4c02-bd81-62e3e489df7a tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:21.477910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-818de7cb-e271-4c02-bd81-62e3e489df7a tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1512 microversion: 2.1 time: 0.140820 Jun 16 11:57:21.490355 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 95/178] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:21 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:21.500447 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8e276fac-2693-434c-8d00-c65216efc81c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:21.501730 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8e276fac-2693-434c-8d00-c65216efc81c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:21.527199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8e276fac-2693-434c-8d00-c65216efc81c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:21.528223 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8e276fac-2693-434c-8d00-c65216efc81c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:21.529174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8e276fac-2693-434c-8d00-c65216efc81c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:21.529828 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8e276fac-2693-434c-8d00-c65216efc81c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:21.638692 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-a61fc50b-fe69-4a47-bbf6-b6a6ab70fda9 req-be0fa09f-73e5-4392-a072-9ed523294bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48de9379-fb44-4eb9-b03d-e38ece0b999c", "name": "network-vif-deleted", "tag": "d5802430-5f4b-4e91-8489-b3d080bd24dc"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:21.667863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-a61fc50b-fe69-4a47-bbf6-b6a6ab70fda9 req-be0fa09f-73e5-4392-a072-9ed523294bbe service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:21.668606 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-a61fc50b-fe69-4a47-bbf6-b6a6ab70fda9 req-be0fa09f-73e5-4392-a072-9ed523294bbe service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:21.697440 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-a61fc50b-fe69-4a47-bbf6-b6a6ab70fda9 req-be0fa09f-73e5-4392-a072-9ed523294bbe service nova] Creating event network-vif-deleted:d5802430-5f4b-4e91-8489-b3d080bd24dc for instance 48de9379-fb44-4eb9-b03d-e38ece0b999c on hv-cinder-84614 Jun 16 11:57:21.704633 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-a61fc50b-fe69-4a47-bbf6-b6a6ab70fda9 req-be0fa09f-73e5-4392-a072-9ed523294bbe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080524 Jun 16 11:57:21.706934 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 96/179] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:57:21.782159 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8e276fac-2693-434c-8d00-c65216efc81c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:21.791333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8e276fac-2693-434c-8d00-c65216efc81c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.295094 Jun 16 11:57:21.791928 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 84/180] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:21 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:22.498390 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-92d9c918-150f-485e-9e05-0533cd44c873 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:22.503658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-92d9c918-150f-485e-9e05-0533cd44c873 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:22.529142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92d9c918-150f-485e-9e05-0533cd44c873 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:22.543204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92d9c918-150f-485e-9e05-0533cd44c873 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:22.543204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92d9c918-150f-485e-9e05-0533cd44c873 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:22.543204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92d9c918-150f-485e-9e05-0533cd44c873 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:22.615340 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-92d9c918-150f-485e-9e05-0533cd44c873 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:22.623652 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-92d9c918-150f-485e-9e05-0533cd44c873 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1346 microversion: 2.1 time: 0.130940 Jun 16 11:57:22.624315 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 97/181] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:22 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:22.808908 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-716607bd-8bdf-49b7-9968-4b2bcedeb666 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:22.809536 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-716607bd-8bdf-49b7-9968-4b2bcedeb666 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:22.816455 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-716607bd-8bdf-49b7-9968-4b2bcedeb666 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:22.817244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-716607bd-8bdf-49b7-9968-4b2bcedeb666 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:22.818014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-716607bd-8bdf-49b7-9968-4b2bcedeb666 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:22.818447 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-716607bd-8bdf-49b7-9968-4b2bcedeb666 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:22.956543 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-716607bd-8bdf-49b7-9968-4b2bcedeb666 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:22.964520 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-716607bd-8bdf-49b7-9968-4b2bcedeb666 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.159046 Jun 16 11:57:22.965089 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 85/182] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:22 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:23.640394 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:23.641908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:23.649072 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:23.649790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:23.650892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:23.651577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:23.656971 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:23.699236 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:23.699685 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:23.700254 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lazy-loading 'fault' on Instance uuid 48de9379-fb44-4eb9-b03d-e38ece0b999c {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:57:23.758847 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae075fce4d94d679a8dc5f508a1c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f23e9a6fbe44c69bb3e4ae47bfe93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:23.768036 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2c41effd-7790-472d-9a68-7b43795d5041 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 200 len: 1351 microversion: 2.1 time: 0.131919 Jun 16 11:57:23.772220 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 98/183] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:23 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 1351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:23.983085 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6cfae8d6-ddb1-42e0-b08d-850847f94762 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:23.983697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6cfae8d6-ddb1-42e0-b08d-850847f94762 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:24.001949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6cfae8d6-ddb1-42e0-b08d-850847f94762 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:24.002731 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6cfae8d6-ddb1-42e0-b08d-850847f94762 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:24.004408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6cfae8d6-ddb1-42e0-b08d-850847f94762 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:24.005039 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6cfae8d6-ddb1-42e0-b08d-850847f94762 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:24.183192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6cfae8d6-ddb1-42e0-b08d-850847f94762 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:24.205014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6cfae8d6-ddb1-42e0-b08d-850847f94762 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.226893 Jun 16 11:57:24.207723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 86/184] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:23 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:24.785321 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:24.793123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:24.793410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:24.793919 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:24.794699 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:24.795138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:24.816081 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] HTTP exception thrown: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Request method failure captured: Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c HTTP/1.1 Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpbuq0umnrymMLz6gQ72ByMcwEh3tY5nCOTuC9N0GzS-v9qTlYmR0EPJwR2yIvx-m2jI61NXkeNGnzQpbwGmmFfAhlxLvd-gs29kI4NUbPfS2w1IGYmWQRzf5KuJadKBsSY0X7JVJvS-dRW2H6vYQI2q4xDxN_Iazrv9aY-HD4u-cU Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 7f23e9a6fbe44c69bb3e4ae47bfe93dc Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 11:57:24.828667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 7f23e9a6fbe44c69bb3e4ae47bfe93dc Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-DeleteServersTestJSON-1470970156-project Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: fae075fce4d94d679a8dc5f508a1c3cf Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-DeleteServersTestJSON-1470970156-project Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:24.829963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '48de9379-fb44-4eb9-b03d-e38ece0b999c'} Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:57:24.830698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:24.832071 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:24.838378 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Returning 404 to user: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:57:24.838378 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cf4f3816-27c9-444a-94b4-19d4251f2660 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 404 len: 111 microversion: 2.1 time: 0.052300 Jun 16 11:57:24.838378 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 99/185] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:24 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 11:57:24.960112 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:24.961093 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:24.967200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:24.967638 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:24.968681 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:24.969366 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:24.984730 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] HTTP exception thrown: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Request method failure captured: Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c/os-volume_attachments HTTP/1.1 Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpbuq0umnrymMLz6gQ72ByMcwEh3tY5nCOTuC9N0GzS-v9qTlYmR0EPJwR2yIvx-m2jI61NXkeNGnzQpbwGmmFfAhlxLvd-gs29kI4NUbPfS2w1IGYmWQRzf5KuJadKBsSY0X7JVJvS-dRW2H6vYQI2q4xDxN_Iazrv9aY-HD4u-cU Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 7f23e9a6fbe44c69bb3e4ae47bfe93dc Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 11:57:24.997435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 7f23e9a6fbe44c69bb3e4ae47bfe93dc Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-DeleteServersTestJSON-1470970156-project Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: fae075fce4d94d679a8dc5f508a1c3cf Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-DeleteServersTestJSON-1470970156-project Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:24.998881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'server_id': '48de9379-fb44-4eb9-b03d-e38ece0b999c'} Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:57:24.999568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:25.000935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:25.002245 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Returning 404 to user: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:57:25.002245 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-42ae0365-0511-4bc0-92b3-0d88ebba7b30 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043108 Jun 16 11:57:25.003044 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 87/186] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 11:57:24 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 11:57:25.224188 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e923d4d6-de14-4f86-a924-0ac4f278cca4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:25.225195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e923d4d6-de14-4f86-a924-0ac4f278cca4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:25.232726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e923d4d6-de14-4f86-a924-0ac4f278cca4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:25.233440 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e923d4d6-de14-4f86-a924-0ac4f278cca4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:25.234271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e923d4d6-de14-4f86-a924-0ac4f278cca4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:25.234897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e923d4d6-de14-4f86-a924-0ac4f278cca4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:25.398025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e923d4d6-de14-4f86-a924-0ac4f278cca4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:25.408104 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e923d4d6-de14-4f86-a924-0ac4f278cca4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.187934 Jun 16 11:57:25.408703 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 100/187] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:25 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:26.374001 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:26.374684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:26.381376 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:26.381840 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:26.382664 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:26.383114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:26.398461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] HTTP exception thrown: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Request method failure captured: Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: DELETE /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c HTTP/1.1 Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpbuq0umnrymMLz6gQ72ByMcwEh3tY5nCOTuC9N0GzS-v9qTlYmR0EPJwR2yIvx-m2jI61NXkeNGnzQpbwGmmFfAhlxLvd-gs29kI4NUbPfS2w1IGYmWQRzf5KuJadKBsSY0X7JVJvS-dRW2H6vYQI2q4xDxN_Iazrv9aY-HD4u-cU Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 7f23e9a6fbe44c69bb3e4ae47bfe93dc Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 11:57:26.400684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 7f23e9a6fbe44c69bb3e4ae47bfe93dc Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-DeleteServersTestJSON-1470970156-project Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: fae075fce4d94d679a8dc5f508a1c3cf Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-DeleteServersTestJSON-1470970156-project Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.402047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '48de9379-fb44-4eb9-b03d-e38ece0b999c'} Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:57:26.402818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.404221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.405607 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Returning 404 to user: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:57:26.405607 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f0c3f1c7-49fc-4410-bc39-17b9fa1742fe tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "DELETE /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 404 len: 111 microversion: 2.1 time: 0.032596 Jun 16 11:57:26.405607 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 88/188] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 11:57:26 2022] DELETE /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 11:57:26.411010 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:26.411663 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] [instance: 48de9379-fb44-4eb9-b03d-e38ece0b999c] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:26.417900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:26.418416 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:26.419314 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:26.419807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:26.425103 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-19555010-c14a-4a5e-9d08-bba07bb9e841 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:26.425634 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-19555010-c14a-4a5e-9d08-bba07bb9e841 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:26.431597 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-19555010-c14a-4a5e-9d08-bba07bb9e841 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:26.432077 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-19555010-c14a-4a5e-9d08-bba07bb9e841 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:26.432836 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-19555010-c14a-4a5e-9d08-bba07bb9e841 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:26.433753 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-19555010-c14a-4a5e-9d08-bba07bb9e841 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:26.434544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] HTTP exception thrown: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Request method failure captured: Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c HTTP/1.1 Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpbuq0umnrymMLz6gQ72ByMcwEh3tY5nCOTuC9N0GzS-v9qTlYmR0EPJwR2yIvx-m2jI61NXkeNGnzQpbwGmmFfAhlxLvd-gs29kI4NUbPfS2w1IGYmWQRzf5KuJadKBsSY0X7JVJvS-dRW2H6vYQI2q4xDxN_Iazrv9aY-HD4u-cU Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 7f23e9a6fbe44c69bb3e4ae47bfe93dc Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 11:57:26.436326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f23e9a6fbe44c69bb3e4ae47bfe93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 7f23e9a6fbe44c69bb3e4ae47bfe93dc Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-DeleteServersTestJSON-1470970156 Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-DeleteServersTestJSON-1470970156-project Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: fae075fce4d94d679a8dc5f508a1c3cf Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-DeleteServersTestJSON-1470970156-project Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.437677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '48de9379-fb44-4eb9-b03d-e38ece0b999c'} Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:57:26.438456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. Jun 16 11:57:26.439479 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:57:26.440453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] Returning 404 to user: Instance 48de9379-fb44-4eb9-b03d-e38ece0b999c could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:57:26.440453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-dcaaa219-d4e6-418c-aee7-4aa648b3b4b5 tempest-DeleteServersTestJSON-1470970156 tempest-DeleteServersTestJSON-1470970156-project] 10.222.0.40 "GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c" status: 404 len: 111 microversion: 2.1 time: 0.030885 Jun 16 11:57:26.440453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 101/189] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:26 2022] GET /compute/v2.1/servers/48de9379-fb44-4eb9-b03d-e38ece0b999c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 11:57:26.579095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-19555010-c14a-4a5e-9d08-bba07bb9e841 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:26.587325 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-19555010-c14a-4a5e-9d08-bba07bb9e841 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.165937 Jun 16 11:57:26.587925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 89/190] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:26 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:27.604698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e918a550-40f5-467d-a4f2-5ca7993f51a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:27.605296 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e918a550-40f5-467d-a4f2-5ca7993f51a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:27.611283 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e918a550-40f5-467d-a4f2-5ca7993f51a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:27.612092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e918a550-40f5-467d-a4f2-5ca7993f51a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:27.613008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e918a550-40f5-467d-a4f2-5ca7993f51a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:27.613610 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e918a550-40f5-467d-a4f2-5ca7993f51a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:27.775045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5c543b10-4f98-4986-a95a-391bb919526c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Action: 'create', calling method: .version_select at 0x7f433451d430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1321410642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqnLdaX4YblIMXFzx7L1trPSrZ+tS6bsDPGrnDxuXV+FY/FlbOvTEkYwXCpehKGPu1QqdW5gql7KUS8JR1CptP7lXsBpLJXpgYxy8XMnAfBD2ZqZF4VG2Xhh4sl3hGelA=="}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:27.806069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-5c543b10-4f98-4986-a95a-391bb919526c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Getting quotas for project 345dc1b6fec149e88f1be7837d126d20. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:57:27.814696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-5c543b10-4f98-4986-a95a-391bb919526c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Getting quotas for user e6730f4274e240dd9da30e5c3bc3679b and project 345dc1b6fec149e88f1be7837d126d20. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:57:27.909695 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5c543b10-4f98-4986-a95a-391bb919526c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.129457 Jun 16 11:57:27.909695 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 90/191] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 11:57:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:57:27.929575 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e918a550-40f5-467d-a4f2-5ca7993f51a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:27.949782 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e918a550-40f5-467d-a4f2-5ca7993f51a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.346741 Jun 16 11:57:27.961086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 102/192] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:27 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:28.200528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1976009502", "imageRef": "924b54a3-14a7-437b-8722-d9bbee074b87", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1321410642", "networks": [{"uuid": "5497cf2d-c02a-410d-9e3b-ae5dc819dbd3"}]}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:28.306270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] validate_networks() for [('5497cf2d-c02a-410d-9e3b-ae5dc819dbd3', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:57:28.814577 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:57:28.817985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:57:28.817985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:57:28.817985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:57:28.817985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:57:28.827245 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:28.827697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:28.828524 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:28.828961 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:28.850842 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Getting quotas for project 345dc1b6fec149e88f1be7837d126d20. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:57:28.855963 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Getting quotas for user e6730f4274e240dd9da30e5c3bc3679b and project 345dc1b6fec149e88f1be7837d126d20. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:57:28.870444 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:57:28.872898 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='924b54a3-14a7-437b-8722-d9bbee074b87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:57:28.977283 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d26307b6-851a-4a89-afb6-2e90e2423376 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:28.977992 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d26307b6-851a-4a89-afb6-2e90e2423376 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:28.984447 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d26307b6-851a-4a89-afb6-2e90e2423376 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:28.984972 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d26307b6-851a-4a89-afb6-2e90e2423376 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:28.985802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d26307b6-851a-4a89-afb6-2e90e2423376 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:28.986301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d26307b6-851a-4a89-afb6-2e90e2423376 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:29.039273 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e00822bc-6980-4dba-b703-bcd6e1b68c4b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842921 Jun 16 11:57:29.045276 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 91/193] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 11:57:29.051097 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ae81a1bf-86bf-4343-9ae9-0d1a11d70edc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:29.051638 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ae81a1bf-86bf-4343-9ae9-0d1a11d70edc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:29.114884 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ae81a1bf-86bf-4343-9ae9-0d1a11d70edc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:29.123206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ae81a1bf-86bf-4343-9ae9-0d1a11d70edc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1259 microversion: 2.1 time: 0.076373 Jun 16 11:57:29.124345 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 92/194] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:29 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1259 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:29.244511 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d26307b6-851a-4a89-afb6-2e90e2423376 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:29.252698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d26307b6-851a-4a89-afb6-2e90e2423376 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.289817 Jun 16 11:57:29.253274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 103/195] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:28 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:30.140144 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-76c6104e-2486-4e66-b729-40eed97f745c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:30.140752 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-76c6104e-2486-4e66-b729-40eed97f745c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:30.202714 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-76c6104e-2486-4e66-b729-40eed97f745c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:30.209936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-76c6104e-2486-4e66-b729-40eed97f745c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1259 microversion: 2.1 time: 0.073539 Jun 16 11:57:30.210501 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 93/196] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:30 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:30.270165 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c3ef959c-2ee2-4ed7-aca4-b7ea27bb7f56 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:30.270769 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c3ef959c-2ee2-4ed7-aca4-b7ea27bb7f56 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:30.280987 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3ef959c-2ee2-4ed7-aca4-b7ea27bb7f56 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:30.281436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3ef959c-2ee2-4ed7-aca4-b7ea27bb7f56 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:30.282222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3ef959c-2ee2-4ed7-aca4-b7ea27bb7f56 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:30.282650 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3ef959c-2ee2-4ed7-aca4-b7ea27bb7f56 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:30.473031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c3ef959c-2ee2-4ed7-aca4-b7ea27bb7f56 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:30.483883 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c3ef959c-2ee2-4ed7-aca4-b7ea27bb7f56 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.218088 Jun 16 11:57:30.486342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 104/197] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:30 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:31.227539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a753cb32-23f9-4fdd-9183-f3b4623cf508 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:31.228172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a753cb32-23f9-4fdd-9183-f3b4623cf508 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:31.235237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a753cb32-23f9-4fdd-9183-f3b4623cf508 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:31.235670 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a753cb32-23f9-4fdd-9183-f3b4623cf508 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:31.236689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a753cb32-23f9-4fdd-9183-f3b4623cf508 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:31.237408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a753cb32-23f9-4fdd-9183-f3b4623cf508 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:31.321978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a753cb32-23f9-4fdd-9183-f3b4623cf508 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:31.330156 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a753cb32-23f9-4fdd-9183-f3b4623cf508 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1311 microversion: 2.1 time: 0.106300 Jun 16 11:57:31.331038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 94/198] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:31 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:31.502726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bda22dd7-49cb-4435-865f-0e1699fa3dda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:31.503318 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bda22dd7-49cb-4435-865f-0e1699fa3dda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:31.509348 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bda22dd7-49cb-4435-865f-0e1699fa3dda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:31.509795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bda22dd7-49cb-4435-865f-0e1699fa3dda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:31.510581 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bda22dd7-49cb-4435-865f-0e1699fa3dda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:31.511021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bda22dd7-49cb-4435-865f-0e1699fa3dda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:31.663675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bda22dd7-49cb-4435-865f-0e1699fa3dda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:31.665315 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bda22dd7-49cb-4435-865f-0e1699fa3dda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.166647 Jun 16 11:57:31.665954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 105/199] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:31 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:32.349819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-093a4790-b525-4d31-9e4c-85db7132417f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:32.351194 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-093a4790-b525-4d31-9e4c-85db7132417f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:32.363415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-093a4790-b525-4d31-9e4c-85db7132417f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:32.363959 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-093a4790-b525-4d31-9e4c-85db7132417f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:32.364695 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-093a4790-b525-4d31-9e4c-85db7132417f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:32.365123 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-093a4790-b525-4d31-9e4c-85db7132417f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:32.470853 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-093a4790-b525-4d31-9e4c-85db7132417f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:32.482144 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-093a4790-b525-4d31-9e4c-85db7132417f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1317 microversion: 2.1 time: 0.137372 Jun 16 11:57:32.482880 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 95/200] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:32 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:32.683252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3cfeb7ff-d253-4ea1-b009-7779d5985b77 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:32.683887 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3cfeb7ff-d253-4ea1-b009-7779d5985b77 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:32.690247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3cfeb7ff-d253-4ea1-b009-7779d5985b77 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:32.691017 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3cfeb7ff-d253-4ea1-b009-7779d5985b77 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:32.691584 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3cfeb7ff-d253-4ea1-b009-7779d5985b77 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:32.692125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3cfeb7ff-d253-4ea1-b009-7779d5985b77 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:32.843678 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3cfeb7ff-d253-4ea1-b009-7779d5985b77 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:32.855092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3cfeb7ff-d253-4ea1-b009-7779d5985b77 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.176156 Jun 16 11:57:32.865571 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 106/201] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:32 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:33.499951 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-85d94d96-0cf2-47d4-8c38-160d40051633 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:33.500622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-85d94d96-0cf2-47d4-8c38-160d40051633 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:33.526381 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-85d94d96-0cf2-47d4-8c38-160d40051633 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:33.526381 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-85d94d96-0cf2-47d4-8c38-160d40051633 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:33.527470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-85d94d96-0cf2-47d4-8c38-160d40051633 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:33.527851 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-85d94d96-0cf2-47d4-8c38-160d40051633 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:33.779653 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-85d94d96-0cf2-47d4-8c38-160d40051633 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:33.788782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-85d94d96-0cf2-47d4-8c38-160d40051633 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.291872 Jun 16 11:57:33.798200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 96/202] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:33 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:33.873232 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c11fb5a0-14dc-4bd9-bddb-05119c1bee60 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:33.875204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c11fb5a0-14dc-4bd9-bddb-05119c1bee60 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:33.883244 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c11fb5a0-14dc-4bd9-bddb-05119c1bee60 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:33.883749 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c11fb5a0-14dc-4bd9-bddb-05119c1bee60 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:33.886134 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c11fb5a0-14dc-4bd9-bddb-05119c1bee60 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:33.886134 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c11fb5a0-14dc-4bd9-bddb-05119c1bee60 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:34.042766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c11fb5a0-14dc-4bd9-bddb-05119c1bee60 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:34.051341 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c11fb5a0-14dc-4bd9-bddb-05119c1bee60 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.182965 Jun 16 11:57:34.056484 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 107/203] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:33 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:34.591996 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-d5796d9e-41ee-4c14-8152-07176712a1b9 req-fd65e63e-f464-4ffc-b4a1-665056d3199d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e80655-be0f-41d4-98b2-feea6405ace6", "tag": "615b821c-cb44-4dee-9938-fc6957f26847"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:34.603265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-d5796d9e-41ee-4c14-8152-07176712a1b9 req-fd65e63e-f464-4ffc-b4a1-665056d3199d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:34.603702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-d5796d9e-41ee-4c14-8152-07176712a1b9 req-fd65e63e-f464-4ffc-b4a1-665056d3199d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:34.629371 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-d5796d9e-41ee-4c14-8152-07176712a1b9 req-fd65e63e-f464-4ffc-b4a1-665056d3199d service nova] Creating event network-changed:615b821c-cb44-4dee-9938-fc6957f26847 for instance 67e80655-be0f-41d4-98b2-feea6405ace6 on hv-cinder-84614 Jun 16 11:57:34.641260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-d5796d9e-41ee-4c14-8152-07176712a1b9 req-fd65e63e-f464-4ffc-b4a1-665056d3199d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053850 Jun 16 11:57:34.643154 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 97/204] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:57:34.813121 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d6baa0fb-15ad-42f8-aed6-07be1dab5b05 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:34.813978 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d6baa0fb-15ad-42f8-aed6-07be1dab5b05 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:34.829272 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6baa0fb-15ad-42f8-aed6-07be1dab5b05 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:34.832422 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6baa0fb-15ad-42f8-aed6-07be1dab5b05 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:34.833707 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6baa0fb-15ad-42f8-aed6-07be1dab5b05 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:34.836454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6baa0fb-15ad-42f8-aed6-07be1dab5b05 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:35.072200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-173cc774-5901-4728-bea7-c1045f135d48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:35.073871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-173cc774-5901-4728-bea7-c1045f135d48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:35.095995 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d6baa0fb-15ad-42f8-aed6-07be1dab5b05 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:35.106555 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d6baa0fb-15ad-42f8-aed6-07be1dab5b05 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.304397 Jun 16 11:57:35.107898 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-173cc774-5901-4728-bea7-c1045f135d48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:35.109091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 108/205] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:34 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:35.110971 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-173cc774-5901-4728-bea7-c1045f135d48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:35.112096 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-173cc774-5901-4728-bea7-c1045f135d48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:35.112523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-173cc774-5901-4728-bea7-c1045f135d48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:35.290155 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-173cc774-5901-4728-bea7-c1045f135d48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:35.304672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-173cc774-5901-4728-bea7-c1045f135d48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.238430 Jun 16 11:57:35.305305 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 98/206] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:35 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:36.124596 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0d636f41-fe86-4f0d-b4f8-bf5908ed6656 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:36.126392 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0d636f41-fe86-4f0d-b4f8-bf5908ed6656 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:36.131694 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0d636f41-fe86-4f0d-b4f8-bf5908ed6656 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:36.132405 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0d636f41-fe86-4f0d-b4f8-bf5908ed6656 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:36.133561 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0d636f41-fe86-4f0d-b4f8-bf5908ed6656 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:36.134159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0d636f41-fe86-4f0d-b4f8-bf5908ed6656 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:36.309648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0d636f41-fe86-4f0d-b4f8-bf5908ed6656 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:36.318358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0d636f41-fe86-4f0d-b4f8-bf5908ed6656 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.197652 Jun 16 11:57:36.329301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 109/207] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:36 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:36.329646 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ddcc41e0-b9ae-4fe3-ad0b-4eb9fd4fb228 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:36.331845 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ddcc41e0-b9ae-4fe3-ad0b-4eb9fd4fb228 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:36.347070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ddcc41e0-b9ae-4fe3-ad0b-4eb9fd4fb228 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:36.348381 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ddcc41e0-b9ae-4fe3-ad0b-4eb9fd4fb228 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:36.351718 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ddcc41e0-b9ae-4fe3-ad0b-4eb9fd4fb228 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:36.353834 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ddcc41e0-b9ae-4fe3-ad0b-4eb9fd4fb228 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:36.530367 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ddcc41e0-b9ae-4fe3-ad0b-4eb9fd4fb228 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:36.538062 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ddcc41e0-b9ae-4fe3-ad0b-4eb9fd4fb228 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.219530 Jun 16 11:57:36.538629 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 99/208] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:36 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:37.336143 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-618c8bda-409d-4490-88b9-b7c3d9a95c74 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:37.336750 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-618c8bda-409d-4490-88b9-b7c3d9a95c74 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:37.343723 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-618c8bda-409d-4490-88b9-b7c3d9a95c74 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:37.344195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-618c8bda-409d-4490-88b9-b7c3d9a95c74 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:37.344958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-618c8bda-409d-4490-88b9-b7c3d9a95c74 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:37.345385 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-618c8bda-409d-4490-88b9-b7c3d9a95c74 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:37.486914 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-618c8bda-409d-4490-88b9-b7c3d9a95c74 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:37.498841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-618c8bda-409d-4490-88b9-b7c3d9a95c74 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.166474 Jun 16 11:57:37.499766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 110/209] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:37 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:37.556044 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c884a402-2705-4082-85c2-814427333da5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:37.557443 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c884a402-2705-4082-85c2-814427333da5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:37.565001 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c884a402-2705-4082-85c2-814427333da5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:37.565527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c884a402-2705-4082-85c2-814427333da5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:37.566365 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c884a402-2705-4082-85c2-814427333da5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:37.566862 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c884a402-2705-4082-85c2-814427333da5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:37.734979 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c884a402-2705-4082-85c2-814427333da5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:37.746686 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c884a402-2705-4082-85c2-814427333da5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.194462 Jun 16 11:57:37.755980 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 100/210] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:37 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:38.517234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fede7f9d-56a9-418d-8e0a-cb7b7867e21b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:38.517932 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-fede7f9d-56a9-418d-8e0a-cb7b7867e21b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:38.526987 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fede7f9d-56a9-418d-8e0a-cb7b7867e21b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:38.527558 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fede7f9d-56a9-418d-8e0a-cb7b7867e21b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:38.528453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fede7f9d-56a9-418d-8e0a-cb7b7867e21b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:38.529092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fede7f9d-56a9-418d-8e0a-cb7b7867e21b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:38.679286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-fede7f9d-56a9-418d-8e0a-cb7b7867e21b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:38.688381 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-fede7f9d-56a9-418d-8e0a-cb7b7867e21b tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.175645 Jun 16 11:57:38.698617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 111/211] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:38 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:38.764679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f4f3b345-75ee-4cfc-94ec-8eb1c07dd5de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:38.765292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f4f3b345-75ee-4cfc-94ec-8eb1c07dd5de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:38.785388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4f3b345-75ee-4cfc-94ec-8eb1c07dd5de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:38.785734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4f3b345-75ee-4cfc-94ec-8eb1c07dd5de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:38.786515 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4f3b345-75ee-4cfc-94ec-8eb1c07dd5de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:38.786943 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4f3b345-75ee-4cfc-94ec-8eb1c07dd5de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:38.970259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:39.153459 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f4f3b345-75ee-4cfc-94ec-8eb1c07dd5de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:39.162084 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f4f3b345-75ee-4cfc-94ec-8eb1c07dd5de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.402170 Jun 16 11:57:39.163121 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 101/212] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:38 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:39.704802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-20a9f5e2-8b73-47a7-842f-c24e5c1ea209 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:39.705407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-20a9f5e2-8b73-47a7-842f-c24e5c1ea209 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:39.707243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=53 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:39.712874 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-20a9f5e2-8b73-47a7-842f-c24e5c1ea209 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:39.713431 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-20a9f5e2-8b73-47a7-842f-c24e5c1ea209 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:39.714273 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-20a9f5e2-8b73-47a7-842f-c24e5c1ea209 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:39.714832 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-20a9f5e2-8b73-47a7-842f-c24e5c1ea209 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:39.857899 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-20a9f5e2-8b73-47a7-842f-c24e5c1ea209 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:39.865835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-20a9f5e2-8b73-47a7-842f-c24e5c1ea209 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.164867 Jun 16 11:57:39.877892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 112/213] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:39 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:40.181965 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9a79d0cd-fa45-4833-9db7-27de04d338e4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:40.182556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9a79d0cd-fa45-4833-9db7-27de04d338e4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:40.188431 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:40.190541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9a79d0cd-fa45-4833-9db7-27de04d338e4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:40.190977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9a79d0cd-fa45-4833-9db7-27de04d338e4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:40.191915 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9a79d0cd-fa45-4833-9db7-27de04d338e4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:40.192504 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9a79d0cd-fa45-4833-9db7-27de04d338e4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:40.210910 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=14 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:40.350667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9a79d0cd-fa45-4833-9db7-27de04d338e4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:40.358530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9a79d0cd-fa45-4833-9db7-27de04d338e4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.180619 Jun 16 11:57:40.359082 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 102/214] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:40 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:40.887377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-222760b2-9d38-48d3-83fc-e2396c3595e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:40.888074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-222760b2-9d38-48d3-83fc-e2396c3595e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:40.894951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-222760b2-9d38-48d3-83fc-e2396c3595e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:40.895639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-222760b2-9d38-48d3-83fc-e2396c3595e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:40.896589 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-222760b2-9d38-48d3-83fc-e2396c3595e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:40.897160 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-222760b2-9d38-48d3-83fc-e2396c3595e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:41.060157 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-222760b2-9d38-48d3-83fc-e2396c3595e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:41.067557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-222760b2-9d38-48d3-83fc-e2396c3595e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.185713 Jun 16 11:57:41.068138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 113/215] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:40 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:41.386018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d2e1296a-6f39-41b3-8a2a-9ad74ab0b64c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:41.386018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d2e1296a-6f39-41b3-8a2a-9ad74ab0b64c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:41.391398 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d2e1296a-6f39-41b3-8a2a-9ad74ab0b64c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:41.391905 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d2e1296a-6f39-41b3-8a2a-9ad74ab0b64c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:41.393160 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d2e1296a-6f39-41b3-8a2a-9ad74ab0b64c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:41.393621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d2e1296a-6f39-41b3-8a2a-9ad74ab0b64c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:41.422760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=100 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:41.562964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d2e1296a-6f39-41b3-8a2a-9ad74ab0b64c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:41.571551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d2e1296a-6f39-41b3-8a2a-9ad74ab0b64c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.197789 Jun 16 11:57:41.572104 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 103/216] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:41 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:42.085075 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-775fe915-e378-4013-a27c-e9758debeed4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:42.085679 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-775fe915-e378-4013-a27c-e9758debeed4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:42.092409 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-775fe915-e378-4013-a27c-e9758debeed4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:42.092863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-775fe915-e378-4013-a27c-e9758debeed4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:42.093969 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-775fe915-e378-4013-a27c-e9758debeed4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:42.094393 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-775fe915-e378-4013-a27c-e9758debeed4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:42.271719 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-775fe915-e378-4013-a27c-e9758debeed4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:42.280534 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-775fe915-e378-4013-a27c-e9758debeed4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.199412 Jun 16 11:57:42.281111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 114/217] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:42 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:42.589243 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f7a6cfd3-7abb-4528-883c-f0da2b0ebcd6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:42.595206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f7a6cfd3-7abb-4528-883c-f0da2b0ebcd6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:42.597535 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f7a6cfd3-7abb-4528-883c-f0da2b0ebcd6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:42.597979 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f7a6cfd3-7abb-4528-883c-f0da2b0ebcd6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:42.598738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f7a6cfd3-7abb-4528-883c-f0da2b0ebcd6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:42.599157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f7a6cfd3-7abb-4528-883c-f0da2b0ebcd6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:42.743921 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f7a6cfd3-7abb-4528-883c-f0da2b0ebcd6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:42.752440 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f7a6cfd3-7abb-4528-883c-f0da2b0ebcd6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.167749 Jun 16 11:57:42.753357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 104/218] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:42 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:43.296841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b45722c9-9e6e-4813-97de-ac557bbfcb50 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:43.297444 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b45722c9-9e6e-4813-97de-ac557bbfcb50 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:43.303429 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b45722c9-9e6e-4813-97de-ac557bbfcb50 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:43.303812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b45722c9-9e6e-4813-97de-ac557bbfcb50 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:43.304596 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b45722c9-9e6e-4813-97de-ac557bbfcb50 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:43.305024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b45722c9-9e6e-4813-97de-ac557bbfcb50 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:43.427279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b45722c9-9e6e-4813-97de-ac557bbfcb50 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:43.430641 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:43.435517 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b45722c9-9e6e-4813-97de-ac557bbfcb50 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.142424 Jun 16 11:57:43.436135 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 115/219] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:43 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:43.771235 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-71ca12ed-89a4-41d3-b71d-84a0fb1004ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:43.772490 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-71ca12ed-89a4-41d3-b71d-84a0fb1004ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:43.779603 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-71ca12ed-89a4-41d3-b71d-84a0fb1004ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:43.780101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-71ca12ed-89a4-41d3-b71d-84a0fb1004ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:43.780842 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-71ca12ed-89a4-41d3-b71d-84a0fb1004ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:43.781274 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-71ca12ed-89a4-41d3-b71d-84a0fb1004ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:44.056875 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-71ca12ed-89a4-41d3-b71d-84a0fb1004ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:44.064226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-71ca12ed-89a4-41d3-b71d-84a0fb1004ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.298632 Jun 16 11:57:44.064794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 105/220] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:43 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:44.460082 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9fbf862e-f294-46de-9c0e-d5306baf9d69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:44.460684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9fbf862e-f294-46de-9c0e-d5306baf9d69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:44.467030 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9fbf862e-f294-46de-9c0e-d5306baf9d69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:44.467467 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9fbf862e-f294-46de-9c0e-d5306baf9d69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:44.468248 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9fbf862e-f294-46de-9c0e-d5306baf9d69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:44.468935 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9fbf862e-f294-46de-9c0e-d5306baf9d69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:44.598736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9fbf862e-f294-46de-9c0e-d5306baf9d69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:44.606684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9fbf862e-f294-46de-9c0e-d5306baf9d69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.150472 Jun 16 11:57:44.607241 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 116/221] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:44 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:45.081390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-180d1a6c-5b32-44fd-b14d-3bcc825d4225 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:45.081915 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-180d1a6c-5b32-44fd-b14d-3bcc825d4225 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:45.088813 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-180d1a6c-5b32-44fd-b14d-3bcc825d4225 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:45.089252 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-180d1a6c-5b32-44fd-b14d-3bcc825d4225 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:45.090003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-180d1a6c-5b32-44fd-b14d-3bcc825d4225 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:45.090430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-180d1a6c-5b32-44fd-b14d-3bcc825d4225 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:45.216538 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-180d1a6c-5b32-44fd-b14d-3bcc825d4225 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:45.224357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-180d1a6c-5b32-44fd-b14d-3bcc825d4225 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.146680 Jun 16 11:57:45.224799 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 106/222] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:45 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:45.622903 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d2fcc371-77f7-4883-839e-787bec341837 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:45.623542 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d2fcc371-77f7-4883-839e-787bec341837 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:45.632281 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2fcc371-77f7-4883-839e-787bec341837 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:45.632281 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2fcc371-77f7-4883-839e-787bec341837 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:45.632281 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2fcc371-77f7-4883-839e-787bec341837 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:45.632281 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2fcc371-77f7-4883-839e-787bec341837 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:45.758695 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d2fcc371-77f7-4883-839e-787bec341837 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:45.766850 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d2fcc371-77f7-4883-839e-787bec341837 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.148292 Jun 16 11:57:45.767402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 117/223] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:45 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:46.241682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1b85122a-169b-42ab-850e-b93e1b3fde48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:46.242295 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1b85122a-169b-42ab-850e-b93e1b3fde48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:46.249364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1b85122a-169b-42ab-850e-b93e1b3fde48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:46.249812 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1b85122a-169b-42ab-850e-b93e1b3fde48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:46.250573 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1b85122a-169b-42ab-850e-b93e1b3fde48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:46.251011 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1b85122a-169b-42ab-850e-b93e1b3fde48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:46.549257 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1b85122a-169b-42ab-850e-b93e1b3fde48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:46.556623 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1b85122a-169b-42ab-850e-b93e1b3fde48 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.318764 Jun 16 11:57:46.557188 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 107/224] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:46 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:46.782365 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a4fd777c-6d1f-4132-ad02-7818647b0b7a tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:46.782993 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a4fd777c-6d1f-4132-ad02-7818647b0b7a tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:46.788919 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a4fd777c-6d1f-4132-ad02-7818647b0b7a tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:46.789355 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a4fd777c-6d1f-4132-ad02-7818647b0b7a tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:46.790091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a4fd777c-6d1f-4132-ad02-7818647b0b7a tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:46.790513 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a4fd777c-6d1f-4132-ad02-7818647b0b7a tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:46.924730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a4fd777c-6d1f-4132-ad02-7818647b0b7a tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:46.933550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a4fd777c-6d1f-4132-ad02-7818647b0b7a tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.154963 Jun 16 11:57:46.934119 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 118/225] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:46 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:47.572960 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6e951497-9728-4756-950a-c4e0f0725f99 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:47.573704 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6e951497-9728-4756-950a-c4e0f0725f99 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:47.580088 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e951497-9728-4756-950a-c4e0f0725f99 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:47.580587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e951497-9728-4756-950a-c4e0f0725f99 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:47.581324 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e951497-9728-4756-950a-c4e0f0725f99 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:47.581755 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e951497-9728-4756-950a-c4e0f0725f99 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:47.783192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6e951497-9728-4756-950a-c4e0f0725f99 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:47.794026 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6e951497-9728-4756-950a-c4e0f0725f99 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.223959 Jun 16 11:57:47.794845 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 108/226] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:47 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:47.952991 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-33de21f4-aca5-4327-99aa-cb9ef1df08f1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:47.953766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-33de21f4-aca5-4327-99aa-cb9ef1df08f1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:47.966198 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-33de21f4-aca5-4327-99aa-cb9ef1df08f1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:47.966703 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-33de21f4-aca5-4327-99aa-cb9ef1df08f1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:47.967801 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-33de21f4-aca5-4327-99aa-cb9ef1df08f1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:47.968014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-33de21f4-aca5-4327-99aa-cb9ef1df08f1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:48.096042 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-33de21f4-aca5-4327-99aa-cb9ef1df08f1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:48.104074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-33de21f4-aca5-4327-99aa-cb9ef1df08f1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.155492 Jun 16 11:57:48.104645 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 119/227] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:47 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:48.810919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fe82060d-01c9-4d84-a8de-f1b1a5e038d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:48.811525 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fe82060d-01c9-4d84-a8de-f1b1a5e038d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:48.818001 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fe82060d-01c9-4d84-a8de-f1b1a5e038d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:48.819541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fe82060d-01c9-4d84-a8de-f1b1a5e038d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:48.819541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fe82060d-01c9-4d84-a8de-f1b1a5e038d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:48.819732 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fe82060d-01c9-4d84-a8de-f1b1a5e038d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:48.947658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fe82060d-01c9-4d84-a8de-f1b1a5e038d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:48.956631 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fe82060d-01c9-4d84-a8de-f1b1a5e038d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.148646 Jun 16 11:57:48.956631 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 109/228] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:48 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:49.122849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-96f7b950-00a8-4685-852b-06d8388e3a77 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:49.122849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-96f7b950-00a8-4685-852b-06d8388e3a77 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:49.127957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-96f7b950-00a8-4685-852b-06d8388e3a77 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:49.128419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-96f7b950-00a8-4685-852b-06d8388e3a77 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:49.129170 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-96f7b950-00a8-4685-852b-06d8388e3a77 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:49.129593 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-96f7b950-00a8-4685-852b-06d8388e3a77 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:49.258345 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-96f7b950-00a8-4685-852b-06d8388e3a77 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:49.265680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-96f7b950-00a8-4685-852b-06d8388e3a77 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.149037 Jun 16 11:57:49.266237 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 120/229] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:49 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:49.972329 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6472c5da-6dfc-4d1e-8283-131acfe6cb26 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:49.973029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6472c5da-6dfc-4d1e-8283-131acfe6cb26 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:49.980326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6472c5da-6dfc-4d1e-8283-131acfe6cb26 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:49.980855 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6472c5da-6dfc-4d1e-8283-131acfe6cb26 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:49.981677 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6472c5da-6dfc-4d1e-8283-131acfe6cb26 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:49.982181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6472c5da-6dfc-4d1e-8283-131acfe6cb26 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:50.124746 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6472c5da-6dfc-4d1e-8283-131acfe6cb26 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:50.130176 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6472c5da-6dfc-4d1e-8283-131acfe6cb26 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1522 microversion: 2.1 time: 0.162041 Jun 16 11:57:50.130770 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 110/230] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:49 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:50.282833 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-09b1f7a7-117c-4cef-8e5a-a0e011e734d4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:50.283343 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-09b1f7a7-117c-4cef-8e5a-a0e011e734d4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:50.289612 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09b1f7a7-117c-4cef-8e5a-a0e011e734d4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:50.290137 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09b1f7a7-117c-4cef-8e5a-a0e011e734d4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:50.290903 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09b1f7a7-117c-4cef-8e5a-a0e011e734d4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:50.291334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09b1f7a7-117c-4cef-8e5a-a0e011e734d4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:50.426050 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-09b1f7a7-117c-4cef-8e5a-a0e011e734d4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:50.433470 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-09b1f7a7-117c-4cef-8e5a-a0e011e734d4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.154814 Jun 16 11:57:50.434029 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 121/231] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:50 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:51.148477 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9067b5fb-68c5-4cd0-87dc-0d07885d024e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:51.149176 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9067b5fb-68c5-4cd0-87dc-0d07885d024e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:51.156200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9067b5fb-68c5-4cd0-87dc-0d07885d024e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:51.156737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9067b5fb-68c5-4cd0-87dc-0d07885d024e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:51.157713 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9067b5fb-68c5-4cd0-87dc-0d07885d024e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:51.158179 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9067b5fb-68c5-4cd0-87dc-0d07885d024e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:51.290738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9067b5fb-68c5-4cd0-87dc-0d07885d024e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:51.298949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9067b5fb-68c5-4cd0-87dc-0d07885d024e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1502 microversion: 2.1 time: 0.156279 Jun 16 11:57:51.299753 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 111/232] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:51 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:51.315324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8b0e7505-a709-467c-838e-a93af908cbc3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:51.315950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8b0e7505-a709-467c-838e-a93af908cbc3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:51.323550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8b0e7505-a709-467c-838e-a93af908cbc3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:51.324019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8b0e7505-a709-467c-838e-a93af908cbc3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:51.324790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8b0e7505-a709-467c-838e-a93af908cbc3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:51.325207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8b0e7505-a709-467c-838e-a93af908cbc3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:51.450883 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ca3d837c-d42c-43a7-ac2d-6b1978502cc3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:51.451580 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ca3d837c-d42c-43a7-ac2d-6b1978502cc3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:51.457004 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8b0e7505-a709-467c-838e-a93af908cbc3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:51.457882 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ca3d837c-d42c-43a7-ac2d-6b1978502cc3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:51.458332 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ca3d837c-d42c-43a7-ac2d-6b1978502cc3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:51.459090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ca3d837c-d42c-43a7-ac2d-6b1978502cc3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:51.459682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ca3d837c-d42c-43a7-ac2d-6b1978502cc3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:51.465395 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8b0e7505-a709-467c-838e-a93af908cbc3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1516 microversion: 2.1 time: 0.153753 Jun 16 11:57:51.465990 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 122/233] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:51 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:51.594619 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ca3d837c-d42c-43a7-ac2d-6b1978502cc3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:51.602003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ca3d837c-d42c-43a7-ac2d-6b1978502cc3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.155721 Jun 16 11:57:51.602775 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 112/234] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:51 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:52.618193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-802686a6-b766-4fb6-9293-e037b7d037b4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:52.618722 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-802686a6-b766-4fb6-9293-e037b7d037b4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:52.625437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-802686a6-b766-4fb6-9293-e037b7d037b4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:52.625691 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-802686a6-b766-4fb6-9293-e037b7d037b4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:52.626433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-802686a6-b766-4fb6-9293-e037b7d037b4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:52.626872 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-802686a6-b766-4fb6-9293-e037b7d037b4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:52.755505 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-802686a6-b766-4fb6-9293-e037b7d037b4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:52.763023 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-802686a6-b766-4fb6-9293-e037b7d037b4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.148616 Jun 16 11:57:52.763581 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 123/235] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:52 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:53.780147 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-677f5424-b602-4ddd-a441-a1a0033b298c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:53.780771 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-677f5424-b602-4ddd-a441-a1a0033b298c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:53.787171 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-677f5424-b602-4ddd-a441-a1a0033b298c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:53.787605 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-677f5424-b602-4ddd-a441-a1a0033b298c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:53.788389 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-677f5424-b602-4ddd-a441-a1a0033b298c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:53.788853 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-677f5424-b602-4ddd-a441-a1a0033b298c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:53.914680 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-677f5424-b602-4ddd-a441-a1a0033b298c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:53.922059 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-677f5424-b602-4ddd-a441-a1a0033b298c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.146377 Jun 16 11:57:53.922617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 113/236] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:53 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:54.938195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-856c2bb7-6e87-4318-93a9-714f7d0d3825 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:54.938801 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-856c2bb7-6e87-4318-93a9-714f7d0d3825 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:54.944870 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-856c2bb7-6e87-4318-93a9-714f7d0d3825 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:54.945315 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-856c2bb7-6e87-4318-93a9-714f7d0d3825 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:54.946072 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-856c2bb7-6e87-4318-93a9-714f7d0d3825 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:54.946504 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-856c2bb7-6e87-4318-93a9-714f7d0d3825 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:55.072238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-856c2bb7-6e87-4318-93a9-714f7d0d3825 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:55.080099 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-856c2bb7-6e87-4318-93a9-714f7d0d3825 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.145583 Jun 16 11:57:55.080724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 124/237] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:54 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:55.268897 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-423a111a-6cc8-402d-aee7-465ace8b76a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:55.269838 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-423a111a-6cc8-402d-aee7-465ace8b76a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:55.276990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-423a111a-6cc8-402d-aee7-465ace8b76a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:55.277425 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-423a111a-6cc8-402d-aee7-465ace8b76a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:55.278168 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-423a111a-6cc8-402d-aee7-465ace8b76a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:55.278601 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-423a111a-6cc8-402d-aee7-465ace8b76a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:55.300627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-423a111a-6cc8-402d-aee7-465ace8b76a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'flavor' on Instance uuid 8294f9b2-7466-4a10-b810-dcc3515bb498 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:57:55.770794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-423a111a-6cc8-402d-aee7-465ace8b76a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498/action" status: 200 len: 32 microversion: 2.1 time: 0.505332 Jun 16 11:57:55.771855 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 114/238] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:57:55 2022] POST /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498/action => generated 32 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 11:57:55.781219 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9202e165-cd27-49fc-9c6c-040a72643523 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:55.782045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9202e165-cd27-49fc-9c6c-040a72643523 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:55.788166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9202e165-cd27-49fc-9c6c-040a72643523 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:55.788605 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9202e165-cd27-49fc-9c6c-040a72643523 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:55.789562 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9202e165-cd27-49fc-9c6c-040a72643523 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:55.790000 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9202e165-cd27-49fc-9c6c-040a72643523 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:55.939789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9202e165-cd27-49fc-9c6c-040a72643523 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:55.950617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9202e165-cd27-49fc-9c6c-040a72643523 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.173091 Jun 16 11:57:55.973908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 125/239] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:55 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:56.059626 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-6d8495df-9984-4adf-bd0e-a2bd71ef6631 req-103584f4-e408-4ce6-b6c9-8d05928c5051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e80655-be0f-41d4-98b2-feea6405ace6", "name": "network-vif-plugged", "status": "completed", "tag": "615b821c-cb44-4dee-9938-fc6957f26847"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:57:56.070219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-6d8495df-9984-4adf-bd0e-a2bd71ef6631 req-103584f4-e408-4ce6-b6c9-8d05928c5051 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:56.070884 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-6d8495df-9984-4adf-bd0e-a2bd71ef6631 req-103584f4-e408-4ce6-b6c9-8d05928c5051 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:56.084115 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-6d8495df-9984-4adf-bd0e-a2bd71ef6631 req-103584f4-e408-4ce6-b6c9-8d05928c5051 service nova] Creating event network-vif-plugged:615b821c-cb44-4dee-9938-fc6957f26847 for instance 67e80655-be0f-41d4-98b2-feea6405ace6 on hv-cinder-84614 Jun 16 11:57:56.089644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-6d8495df-9984-4adf-bd0e-a2bd71ef6631 req-103584f4-e408-4ce6-b6c9-8d05928c5051 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036131 Jun 16 11:57:56.090290 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 115/240] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:57:56.098135 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5ff24a50-d2c4-42ed-ae73-2a1976f686a2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:56.099547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5ff24a50-d2c4-42ed-ae73-2a1976f686a2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:56.106306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5ff24a50-d2c4-42ed-ae73-2a1976f686a2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:56.106912 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5ff24a50-d2c4-42ed-ae73-2a1976f686a2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:56.108231 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5ff24a50-d2c4-42ed-ae73-2a1976f686a2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:56.108231 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5ff24a50-d2c4-42ed-ae73-2a1976f686a2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:56.329961 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5ff24a50-d2c4-42ed-ae73-2a1976f686a2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:56.339205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5ff24a50-d2c4-42ed-ae73-2a1976f686a2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.244322 Jun 16 11:57:56.339771 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 126/241] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:56 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:56.969770 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e58dbda3-4851-477e-93f4-7da5857a6677 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:56.970459 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e58dbda3-4851-477e-93f4-7da5857a6677 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:56.976598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e58dbda3-4851-477e-93f4-7da5857a6677 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:56.977105 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e58dbda3-4851-477e-93f4-7da5857a6677 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:56.977857 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e58dbda3-4851-477e-93f4-7da5857a6677 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:56.978281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e58dbda3-4851-477e-93f4-7da5857a6677 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:57.153321 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e58dbda3-4851-477e-93f4-7da5857a6677 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:57.160894 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e58dbda3-4851-477e-93f4-7da5857a6677 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.196113 Jun 16 11:57:57.161674 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 116/242] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:56 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:57.356828 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-017ace87-019f-4545-b018-63e569c748fd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:57.357357 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-017ace87-019f-4545-b018-63e569c748fd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:57.363280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-017ace87-019f-4545-b018-63e569c748fd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:57.363726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-017ace87-019f-4545-b018-63e569c748fd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:57.364522 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-017ace87-019f-4545-b018-63e569c748fd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:57.364979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-017ace87-019f-4545-b018-63e569c748fd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:57.507358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-017ace87-019f-4545-b018-63e569c748fd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:57.514846 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-017ace87-019f-4545-b018-63e569c748fd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1359 microversion: 2.1 time: 0.162532 Jun 16 11:57:57.515416 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 127/243] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:57 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:57:58.178159 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-719b43bf-5e7b-4f66-80ef-da24382b640b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:58.182059 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-719b43bf-5e7b-4f66-80ef-da24382b640b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:58.186032 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-719b43bf-5e7b-4f66-80ef-da24382b640b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:58.186481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-719b43bf-5e7b-4f66-80ef-da24382b640b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:58.187244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-719b43bf-5e7b-4f66-80ef-da24382b640b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:58.187672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-719b43bf-5e7b-4f66-80ef-da24382b640b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:58.359144 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-719b43bf-5e7b-4f66-80ef-da24382b640b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:58.370118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-719b43bf-5e7b-4f66-80ef-da24382b640b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.193695 Jun 16 11:57:58.370118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 117/244] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:58 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:58.531401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b9ee221e-db98-4e64-8988-c6e2e34716a1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:58.532167 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b9ee221e-db98-4e64-8988-c6e2e34716a1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:58.538346 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b9ee221e-db98-4e64-8988-c6e2e34716a1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:58.538793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b9ee221e-db98-4e64-8988-c6e2e34716a1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:58.539545 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b9ee221e-db98-4e64-8988-c6e2e34716a1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:58.540005 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b9ee221e-db98-4e64-8988-c6e2e34716a1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:58.836284 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b9ee221e-db98-4e64-8988-c6e2e34716a1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:58.844159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b9ee221e-db98-4e64-8988-c6e2e34716a1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1549 microversion: 2.1 time: 0.316565 Jun 16 11:57:58.845023 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 128/245] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:58 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1549 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:58.861299 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4174ad7f-1d24-4034-9360-5b674d907a27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:58.863364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4174ad7f-1d24-4034-9360-5b674d907a27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:58.867747 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4174ad7f-1d24-4034-9360-5b674d907a27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:58.868292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4174ad7f-1d24-4034-9360-5b674d907a27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:58.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4174ad7f-1d24-4034-9360-5b674d907a27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:58.870207 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4174ad7f-1d24-4034-9360-5b674d907a27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:59.015267 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4174ad7f-1d24-4034-9360-5b674d907a27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:59.017586 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:59.023348 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4174ad7f-1d24-4034-9360-5b674d907a27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1549 microversion: 2.1 time: 0.165839 Jun 16 11:57:59.023934 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 118/246] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:58 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:59.038811 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:59.043017 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:59.045484 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Searching by: {'deleted': False, 'project_id': '345dc1b6fec149e88f1be7837d126d20'} {{(pid=125054) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 11:57:59.050372 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:59.050811 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:59.051642 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:59.052099 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:59.147247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.multi_cell_list [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125054) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 11:57:59.240105 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-75e68a07-3114-4429-bf69-e8f13e191964 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204939 Jun 16 11:57:59.240684 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 129/247] 10.222.0.40 () {58 vars in 1124 bytes} [Thu Jun 16 11:57:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:57:59.250712 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3682ce30-62b4-4ed7-b151-9ad714d8e1d9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:59.251317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3682ce30-62b4-4ed7-b151-9ad714d8e1d9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:59.257729 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3682ce30-62b4-4ed7-b151-9ad714d8e1d9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:59.258166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3682ce30-62b4-4ed7-b151-9ad714d8e1d9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:59.258925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3682ce30-62b4-4ed7-b151-9ad714d8e1d9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:59.259348 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3682ce30-62b4-4ed7-b151-9ad714d8e1d9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:59.384558 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b3139fc8-956a-485a-b3d5-dba4043ddfee tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:57:59.385483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b3139fc8-956a-485a-b3d5-dba4043ddfee tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:57:59.391488 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b3139fc8-956a-485a-b3d5-dba4043ddfee tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:59.391972 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b3139fc8-956a-485a-b3d5-dba4043ddfee tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:59.392741 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b3139fc8-956a-485a-b3d5-dba4043ddfee tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:57:59.393172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b3139fc8-956a-485a-b3d5-dba4043ddfee tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:57:59.396318 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3682ce30-62b4-4ed7-b151-9ad714d8e1d9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:59.405641 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3682ce30-62b4-4ed7-b151-9ad714d8e1d9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1549 microversion: 2.1 time: 0.158647 Jun 16 11:57:59.406203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 119/248] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:59 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:57:59.531999 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b3139fc8-956a-485a-b3d5-dba4043ddfee tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:57:59.555200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b3139fc8-956a-485a-b3d5-dba4043ddfee tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.172608 Jun 16 11:57:59.557668 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 130/249] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:57:59 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:00.573513 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-45fc2f24-6172-45a9-9bd9-40db3a4b5fa3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:00.574141 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-45fc2f24-6172-45a9-9bd9-40db3a4b5fa3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:00.580865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-45fc2f24-6172-45a9-9bd9-40db3a4b5fa3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:00.581307 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-45fc2f24-6172-45a9-9bd9-40db3a4b5fa3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:00.582065 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-45fc2f24-6172-45a9-9bd9-40db3a4b5fa3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:00.582494 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-45fc2f24-6172-45a9-9bd9-40db3a4b5fa3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:00.733151 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-45fc2f24-6172-45a9-9bd9-40db3a4b5fa3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:00.743379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-45fc2f24-6172-45a9-9bd9-40db3a4b5fa3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.172117 Jun 16 11:58:00.743379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 120/250] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:00 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:01.758494 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5adb44f2-b5f8-4b8d-9324-979e9a0a235e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:01.759235 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5adb44f2-b5f8-4b8d-9324-979e9a0a235e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:01.767469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5adb44f2-b5f8-4b8d-9324-979e9a0a235e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:01.767469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5adb44f2-b5f8-4b8d-9324-979e9a0a235e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:01.767469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5adb44f2-b5f8-4b8d-9324-979e9a0a235e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:01.767469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5adb44f2-b5f8-4b8d-9324-979e9a0a235e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:01.918741 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5adb44f2-b5f8-4b8d-9324-979e9a0a235e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:01.929323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5adb44f2-b5f8-4b8d-9324-979e9a0a235e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.174782 Jun 16 11:58:01.930369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 131/251] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:01 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:02.063722 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0d334074-d2b8-4045-a321-ba007c07f05d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb1b49c6-0eef-4145-b506-3d0270d09d01"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:02.064782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0d334074-d2b8-4045-a321-ba007c07f05d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:02.071503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0d334074-d2b8-4045-a321-ba007c07f05d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:02.072101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0d334074-d2b8-4045-a321-ba007c07f05d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:02.072752 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0d334074-d2b8-4045-a321-ba007c07f05d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:02.073217 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0d334074-d2b8-4045-a321-ba007c07f05d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:02.877004 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0d334074-d2b8-4045-a321-ba007c07f05d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "POST /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817351 Jun 16 11:58:02.877618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 121/252] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 11:58:02 2022] POST /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:02.953407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-774c7ddb-cd81-4ed8-9379-c6a2a96f8daf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:02.954313 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-774c7ddb-cd81-4ed8-9379-c6a2a96f8daf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:02.961158 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-774c7ddb-cd81-4ed8-9379-c6a2a96f8daf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:02.961731 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-774c7ddb-cd81-4ed8-9379-c6a2a96f8daf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:02.962507 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-774c7ddb-cd81-4ed8-9379-c6a2a96f8daf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:02.962946 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-774c7ddb-cd81-4ed8-9379-c6a2a96f8daf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:02.969189 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:03.106226 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-774c7ddb-cd81-4ed8-9379-c6a2a96f8daf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:03.113683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-774c7ddb-cd81-4ed8-9379-c6a2a96f8daf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.164909 Jun 16 11:58:03.114270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 132/253] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:02 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:04.131599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0c8b4834-e98d-458d-bba8-b24b77c773a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:04.132429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0c8b4834-e98d-458d-bba8-b24b77c773a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:04.139302 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0c8b4834-e98d-458d-bba8-b24b77c773a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:04.139742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0c8b4834-e98d-458d-bba8-b24b77c773a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:04.140927 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0c8b4834-e98d-458d-bba8-b24b77c773a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:04.141360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0c8b4834-e98d-458d-bba8-b24b77c773a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:04.269195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0c8b4834-e98d-458d-bba8-b24b77c773a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:04.277060 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0c8b4834-e98d-458d-bba8-b24b77c773a7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.149473 Jun 16 11:58:04.278126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 122/254] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:04 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:04.452994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8d8889b5-6c27-4fa5-9ef2-075cef86c9af tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:04.453526 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8d8889b5-6c27-4fa5-9ef2-075cef86c9af tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:04.459361 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d8889b5-6c27-4fa5-9ef2-075cef86c9af tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:04.459802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d8889b5-6c27-4fa5-9ef2-075cef86c9af tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:04.460590 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d8889b5-6c27-4fa5-9ef2-075cef86c9af tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:04.461019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d8889b5-6c27-4fa5-9ef2-075cef86c9af tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:04.484182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8d8889b5-6c27-4fa5-9ef2-075cef86c9af tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/ips" status: 200 len: 151 microversion: 2.20 time: 0.035138 Jun 16 11:58:04.484728 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 133/255] 10.222.0.40 () {60 vars in 1288 bytes} [Thu Jun 16 11:58:04 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 11:58:05.299992 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-dba8f93a-be8c-4289-ac48-c74e5d9500cd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:05.299992 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-dba8f93a-be8c-4289-ac48-c74e5d9500cd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:05.302036 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dba8f93a-be8c-4289-ac48-c74e5d9500cd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:05.302479 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dba8f93a-be8c-4289-ac48-c74e5d9500cd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:05.303236 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dba8f93a-be8c-4289-ac48-c74e5d9500cd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:05.303667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dba8f93a-be8c-4289-ac48-c74e5d9500cd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:05.428142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-dba8f93a-be8c-4289-ac48-c74e5d9500cd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:05.435483 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-dba8f93a-be8c-4289-ac48-c74e5d9500cd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.145221 Jun 16 11:58:05.436073 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 123/256] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:05 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:06.451499 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-92dfa02e-7924-4348-972e-38ea24527e2a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:06.452138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-92dfa02e-7924-4348-972e-38ea24527e2a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:06.458319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92dfa02e-7924-4348-972e-38ea24527e2a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:06.458765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92dfa02e-7924-4348-972e-38ea24527e2a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:06.459531 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92dfa02e-7924-4348-972e-38ea24527e2a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:06.459984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92dfa02e-7924-4348-972e-38ea24527e2a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:06.598584 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-92dfa02e-7924-4348-972e-38ea24527e2a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:06.604220 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-92dfa02e-7924-4348-972e-38ea24527e2a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.156583 Jun 16 11:58:06.604847 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 134/257] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:06 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:07.624480 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-484951a2-85e3-4104-b0a5-b6e53d6c2b66 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:07.625174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-484951a2-85e3-4104-b0a5-b6e53d6c2b66 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:07.632238 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-484951a2-85e3-4104-b0a5-b6e53d6c2b66 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:07.632663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-484951a2-85e3-4104-b0a5-b6e53d6c2b66 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:07.633423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-484951a2-85e3-4104-b0a5-b6e53d6c2b66 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:07.633861 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-484951a2-85e3-4104-b0a5-b6e53d6c2b66 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:07.777392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-484951a2-85e3-4104-b0a5-b6e53d6c2b66 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:07.791049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-484951a2-85e3-4104-b0a5-b6e53d6c2b66 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.166017 Jun 16 11:58:07.791049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 124/258] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:07 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:08.091444 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ba7825c4-706b-43c6-8f99-80e06ec5a57a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:08.092046 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ba7825c4-706b-43c6-8f99-80e06ec5a57a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:08.099766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ba7825c4-706b-43c6-8f99-80e06ec5a57a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:08.100453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ba7825c4-706b-43c6-8f99-80e06ec5a57a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:08.101430 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ba7825c4-706b-43c6-8f99-80e06ec5a57a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:08.102030 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ba7825c4-706b-43c6-8f99-80e06ec5a57a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:08.102244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-de9c97ac-7ac1-4904-9497-17b7f38e3cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:08.102736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-de9c97ac-7ac1-4904-9497-17b7f38e3cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:08.109556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-de9c97ac-7ac1-4904-9497-17b7f38e3cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:08.110000 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-de9c97ac-7ac1-4904-9497-17b7f38e3cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:08.110833 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-de9c97ac-7ac1-4904-9497-17b7f38e3cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:08.111195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-de9c97ac-7ac1-4904-9497-17b7f38e3cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:08.135085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-ba7825c4-706b-43c6-8f99-80e06ec5a57a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lazy-loading 'flavor' on Instance uuid 6646f09a-70e9-487b-98f0-89ab1fe5508a {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:58:08.137599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-de9c97ac-7ac1-4904-9497-17b7f38e3cd3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/ips" status: 200 len: 147 microversion: 2.1 time: 0.039084 Jun 16 11:58:08.143130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 125/259] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 11:58:08 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:58:08.651380 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ba7825c4-706b-43c6-8f99-80e06ec5a57a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/action" status: 202 len: 0 microversion: 2.20 time: 0.564111 Jun 16 11:58:08.651890 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 135/260] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jun 16 11:58:08 2022] POST /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 11:58:08.662664 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:08.663356 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:08.672228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:08.672228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:08.672228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:08.672228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:08.804654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b533a4e6-e88e-403a-87e3-e3a3db8a5bba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:08.804654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b533a4e6-e88e-403a-87e3-e3a3db8a5bba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:08.810619 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b533a4e6-e88e-403a-87e3-e3a3db8a5bba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:08.811166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b533a4e6-e88e-403a-87e3-e3a3db8a5bba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:08.811890 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b533a4e6-e88e-403a-87e3-e3a3db8a5bba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:08.812328 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b533a4e6-e88e-403a-87e3-e3a3db8a5bba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:08.815111 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:08.823791 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:08.825946 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:08.827110 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e632a6a2-31f7-4bcd-84c9-da985996fe38 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.168350 Jun 16 11:58:08.828997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 126/261] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:08 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:58:08.983143 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b533a4e6-e88e-403a-87e3-e3a3db8a5bba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:08.990949 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b533a4e6-e88e-403a-87e3-e3a3db8a5bba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.192212 Jun 16 11:58:09.000196 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 136/262] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:08 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:09.846176 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:09.846708 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:09.853163 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:09.853600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:09.854350 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:09.854804 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:09.979146 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:09.987397 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:09.988906 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:09.990042 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-febf1ed6-01b9-44a6-9028-cd364506c306 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.148309 Jun 16 11:58:09.990599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 127/263] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:09 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:10.007641 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2271d7d3-fe56-4bd2-9251-6eb02e64179f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:10.008277 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2271d7d3-fe56-4bd2-9251-6eb02e64179f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:10.010238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:10.015150 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2271d7d3-fe56-4bd2-9251-6eb02e64179f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:10.015594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2271d7d3-fe56-4bd2-9251-6eb02e64179f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:10.016380 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2271d7d3-fe56-4bd2-9251-6eb02e64179f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:10.016816 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2271d7d3-fe56-4bd2-9251-6eb02e64179f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:10.144135 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2271d7d3-fe56-4bd2-9251-6eb02e64179f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:10.151402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2271d7d3-fe56-4bd2-9251-6eb02e64179f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.147541 Jun 16 11:58:10.151974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 137/264] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:10 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:11.009132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:11.009736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:11.016787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:11.017225 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:11.017981 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:11.018406 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:11.147906 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:11.155758 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:11.157275 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:11.158423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-90c374a1-ee92-4f87-ae66-075131567893 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.153221 Jun 16 11:58:11.158976 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 128/265] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:11 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:11.167768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7906361a-aaa1-4542-bf37-816453361af8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:11.168414 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7906361a-aaa1-4542-bf37-816453361af8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:11.170277 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=52 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:11.174916 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7906361a-aaa1-4542-bf37-816453361af8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:11.175354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7906361a-aaa1-4542-bf37-816453361af8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:11.176126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7906361a-aaa1-4542-bf37-816453361af8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:11.176555 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7906361a-aaa1-4542-bf37-816453361af8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:11.309525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7906361a-aaa1-4542-bf37-816453361af8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:11.317079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7906361a-aaa1-4542-bf37-816453361af8 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.153023 Jun 16 11:58:11.317638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 138/266] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:11 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:12.178457 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:12.179052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:12.185962 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:12.186397 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:12.187164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:12.187587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:12.314064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:12.321999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:12.323510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:12.325207 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c469b3e9-968b-47f0-a7af-84b35926d5d8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.150930 Jun 16 11:58:12.325764 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 129/267] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:12 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:58:12.338222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3d61ce45-6aeb-498c-9572-a2893797bdd7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:12.338823 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3d61ce45-6aeb-498c-9572-a2893797bdd7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:12.345666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d61ce45-6aeb-498c-9572-a2893797bdd7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:12.346098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d61ce45-6aeb-498c-9572-a2893797bdd7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:12.346848 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d61ce45-6aeb-498c-9572-a2893797bdd7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:12.347286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d61ce45-6aeb-498c-9572-a2893797bdd7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:12.476583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3d61ce45-6aeb-498c-9572-a2893797bdd7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:12.484252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3d61ce45-6aeb-498c-9572-a2893797bdd7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.149609 Jun 16 11:58:12.484699 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 139/268] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:12 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:13.344424 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:13.345041 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:13.347451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=56 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:13.352198 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:13.352634 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:13.353396 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:13.353822 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:13.484499 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:13.492506 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:13.494005 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:13.495145 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ff697c93-5c1e-4d31-9ac5-eda1fcb4fb67 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.155803 Jun 16 11:58:13.498132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 130/269] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:13 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:13.501968 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-149b9d93-90f3-488b-9846-a880f94ddce1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:13.502713 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-149b9d93-90f3-488b-9846-a880f94ddce1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:13.509464 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-149b9d93-90f3-488b-9846-a880f94ddce1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:13.509909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-149b9d93-90f3-488b-9846-a880f94ddce1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:13.510671 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-149b9d93-90f3-488b-9846-a880f94ddce1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:13.511098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-149b9d93-90f3-488b-9846-a880f94ddce1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:13.643706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-149b9d93-90f3-488b-9846-a880f94ddce1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:13.651112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-149b9d93-90f3-488b-9846-a880f94ddce1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.154198 Jun 16 11:58:13.651674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 140/270] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:13 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:14.513706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:14.514314 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:14.522001 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:14.522389 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:14.523150 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:14.523577 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:14.661521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:14.671687 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3bee9a63-3bd8-44c8-8f4e-684131bbc754 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:14.673040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3bee9a63-3bd8-44c8-8f4e-684131bbc754 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:14.681828 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3bee9a63-3bd8-44c8-8f4e-684131bbc754 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:14.681948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:14.682057 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3bee9a63-3bd8-44c8-8f4e-684131bbc754 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:14.682611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:14.682973 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3bee9a63-3bd8-44c8-8f4e-684131bbc754 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:14.684049 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3bee9a63-3bd8-44c8-8f4e-684131bbc754 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:14.684751 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5f2c031b-c7f7-4313-baa8-97093ac24f68 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.175328 Jun 16 11:58:14.698447 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 131/271] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:14 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:14.741532 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-bd5c94c6-c603-4141-a993-d2b57e478796 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:14.742484 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-bd5c94c6-c603-4141-a993-d2b57e478796 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:14.750762 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd5c94c6-c603-4141-a993-d2b57e478796 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:14.751213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd5c94c6-c603-4141-a993-d2b57e478796 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:14.752014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd5c94c6-c603-4141-a993-d2b57e478796 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:14.752904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bd5c94c6-c603-4141-a993-d2b57e478796 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:14.837287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3bee9a63-3bd8-44c8-8f4e-684131bbc754 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:14.848063 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3bee9a63-3bd8-44c8-8f4e-684131bbc754 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.182953 Jun 16 11:58:14.859553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 141/272] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:14 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:14.918803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-bd5c94c6-c603-4141-a993-d2b57e478796 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:14.926742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-bd5c94c6-c603-4141-a993-d2b57e478796 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1595 microversion: 2.1 time: 0.189214 Jun 16 11:58:14.927628 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 132/273] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:14 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1595 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:15.707776 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:15.708410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:15.714719 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:15.715162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:15.715939 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:15.716372 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:15.844404 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:15.852460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:15.854034 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:15.855273 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-52929b0c-7025-49de-b5c4-e6f8fc1413b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.151211 Jun 16 11:58:15.855834 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 142/274] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:15 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:15.866867 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b8124a46-7153-42ce-9816-9c803d0f9c96 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:15.868129 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b8124a46-7153-42ce-9816-9c803d0f9c96 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:15.875406 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8124a46-7153-42ce-9816-9c803d0f9c96 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:15.875850 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8124a46-7153-42ce-9816-9c803d0f9c96 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:15.876638 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8124a46-7153-42ce-9816-9c803d0f9c96 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:15.877241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8124a46-7153-42ce-9816-9c803d0f9c96 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:16.369380 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b8124a46-7153-42ce-9816-9c803d0f9c96 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:16.376775 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b8124a46-7153-42ce-9816-9c803d0f9c96 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.513687 Jun 16 11:58:16.377519 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 133/275] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:15 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:16.874688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:16.875220 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:16.881301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:16.881750 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:16.882545 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:16.882979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:17.017346 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:17.029173 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:17.030683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:17.032057 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2bf6aed3-234c-44eb-9a6e-fb59779003d6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.161428 Jun 16 11:58:17.038581 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 143/276] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:16 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:17.368437 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-c681804b-2bac-4305-aa73-7bc4bac36ddd req-20847e9d-21b9-4640-abfd-bea4403a6edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e80655-be0f-41d4-98b2-feea6405ace6", "tag": "615b821c-cb44-4dee-9938-fc6957f26847"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:17.378054 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-c681804b-2bac-4305-aa73-7bc4bac36ddd req-20847e9d-21b9-4640-abfd-bea4403a6edf service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:17.378610 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-c681804b-2bac-4305-aa73-7bc4bac36ddd req-20847e9d-21b9-4640-abfd-bea4403a6edf service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:17.393337 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-c681804b-2bac-4305-aa73-7bc4bac36ddd req-20847e9d-21b9-4640-abfd-bea4403a6edf service nova] Creating event network-changed:615b821c-cb44-4dee-9938-fc6957f26847 for instance 67e80655-be0f-41d4-98b2-feea6405ace6 on hv-cinder-84614 Jun 16 11:58:17.393562 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5bd0dc4d-a1b9-4ba8-a517-f0e8f4869c80 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:17.394192 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5bd0dc4d-a1b9-4ba8-a517-f0e8f4869c80 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:17.399038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-c681804b-2bac-4305-aa73-7bc4bac36ddd req-20847e9d-21b9-4640-abfd-bea4403a6edf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034609 Jun 16 11:58:17.399801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 134/277] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:17.402256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5bd0dc4d-a1b9-4ba8-a517-f0e8f4869c80 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:17.402707 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5bd0dc4d-a1b9-4ba8-a517-f0e8f4869c80 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:17.403510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5bd0dc4d-a1b9-4ba8-a517-f0e8f4869c80 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:17.403979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5bd0dc4d-a1b9-4ba8-a517-f0e8f4869c80 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:17.566193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5bd0dc4d-a1b9-4ba8-a517-f0e8f4869c80 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:17.574053 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5bd0dc4d-a1b9-4ba8-a517-f0e8f4869c80 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.184379 Jun 16 11:58:17.583664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 144/278] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:17 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:18.053315 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:18.054238 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:18.062418 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:18.063388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:18.064535 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:18.065191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:18.070174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:18.233260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:18.244016 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:18.245819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:18.247411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-785eabfc-8341-4e88-a588-34d4028d022a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.199762 Jun 16 11:58:18.248531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 135/279] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:18 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:18.554828 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-045b7890-c3b9-4ae1-8a4f-4a10ab9a6406 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8891e5cc-0e9c-4025-bcb5-9f4ac71e5ebe"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:18.555367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-045b7890-c3b9-4ae1-8a4f-4a10ab9a6406 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:18.561568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-045b7890-c3b9-4ae1-8a4f-4a10ab9a6406 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:18.562013 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-045b7890-c3b9-4ae1-8a4f-4a10ab9a6406 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:18.562782 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-045b7890-c3b9-4ae1-8a4f-4a10ab9a6406 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:18.563219 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-045b7890-c3b9-4ae1-8a4f-4a10ab9a6406 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:18.595897 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-962c45fe-7270-49ed-9354-9a8f5b4b6f7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:18.597028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-962c45fe-7270-49ed-9354-9a8f5b4b6f7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:18.606119 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-962c45fe-7270-49ed-9354-9a8f5b4b6f7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:18.606639 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-962c45fe-7270-49ed-9354-9a8f5b4b6f7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:18.608001 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-962c45fe-7270-49ed-9354-9a8f5b4b6f7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:18.608557 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-962c45fe-7270-49ed-9354-9a8f5b4b6f7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:18.768630 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-962c45fe-7270-49ed-9354-9a8f5b4b6f7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:18.776772 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-962c45fe-7270-49ed-9354-9a8f5b4b6f7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.187018 Jun 16 11:58:18.777340 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 136/280] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:18 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:19.267826 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:19.267826 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:19.277448 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:19.278132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:19.279156 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:19.279848 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:19.506982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:19.512925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:19.514476 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:19.515644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ec8cefb1-5387-4547-a105-234fecd99218 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.253728 Jun 16 11:58:19.516281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 137/281] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:19 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:58:19.693340 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:19.775086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-045b7890-c3b9-4ae1-8a4f-4a10ab9a6406 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.225172 Jun 16 11:58:19.781166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 145/282] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 11:58:18 2022] POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/os-volume_attachments => generated 194 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:19.793682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fe4498bc-011d-4241-9461-7e28a9360c21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:19.794288 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fe4498bc-011d-4241-9461-7e28a9360c21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:19.801800 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fe4498bc-011d-4241-9461-7e28a9360c21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:19.802460 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fe4498bc-011d-4241-9461-7e28a9360c21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:19.803453 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fe4498bc-011d-4241-9461-7e28a9360c21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:19.803990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fe4498bc-011d-4241-9461-7e28a9360c21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:19.961560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fe4498bc-011d-4241-9461-7e28a9360c21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:19.970009 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fe4498bc-011d-4241-9461-7e28a9360c21 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.180274 Jun 16 11:58:19.970833 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 138/283] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:19 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:20.305595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4a09c84f-2dd2-4845-b728-34f7ad7d5f93 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1811487829"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:20.306218 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4a09c84f-2dd2-4845-b728-34f7ad7d5f93 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:20.314465 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a09c84f-2dd2-4845-b728-34f7ad7d5f93 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:20.314918 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a09c84f-2dd2-4845-b728-34f7ad7d5f93 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:20.315977 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a09c84f-2dd2-4845-b728-34f7ad7d5f93 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:20.316631 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a09c84f-2dd2-4845-b728-34f7ad7d5f93 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:20.448345 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.network.security_group_api [None req-4a09c84f-2dd2-4845-b728-34f7ad7d5f93 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Adding security group 9262f9a3-f86d-4833-a163-42ecdbf584e6 to port 615b821c-cb44-4dee-9938-fc6957f26847 Jun 16 11:58:20.534234 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:20.534793 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:20.541148 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:20.541591 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:20.542377 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:20.543343 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:20.675789 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:20.686332 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:20.688131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:20.690379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-063e8946-cb81-4c9c-a6f0-45739dc4c778 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.160498 Jun 16 11:58:20.692528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 139/284] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:20 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:20.947042 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4a09c84f-2dd2-4845-b728-34f7ad7d5f93 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "POST /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/action" status: 202 len: 0 microversion: 2.1 time: 0.642823 Jun 16 11:58:20.947042 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 146/285] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:58:20 2022] POST /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 11:58:20.957077 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-876dc01b-aad8-4c66-b4dd-6a6d96c40e6d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:20.957666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-5154eb76-e233-442c-8853-d270124cd790 req-40f0ca01-cb88-4a38-95ad-eab24d951430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e80655-be0f-41d4-98b2-feea6405ace6", "tag": "615b821c-cb44-4dee-9938-fc6957f26847"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:20.957997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-876dc01b-aad8-4c66-b4dd-6a6d96c40e6d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:20.967123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-5154eb76-e233-442c-8853-d270124cd790 req-40f0ca01-cb88-4a38-95ad-eab24d951430 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:20.967797 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-5154eb76-e233-442c-8853-d270124cd790 req-40f0ca01-cb88-4a38-95ad-eab24d951430 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:20.978941 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-876dc01b-aad8-4c66-b4dd-6a6d96c40e6d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:20.979825 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-876dc01b-aad8-4c66-b4dd-6a6d96c40e6d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:20.982007 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-876dc01b-aad8-4c66-b4dd-6a6d96c40e6d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:20.982771 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-876dc01b-aad8-4c66-b4dd-6a6d96c40e6d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:21.000494 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-5154eb76-e233-442c-8853-d270124cd790 req-40f0ca01-cb88-4a38-95ad-eab24d951430 service nova] Creating event network-changed:615b821c-cb44-4dee-9938-fc6957f26847 for instance 67e80655-be0f-41d4-98b2-feea6405ace6 on hv-cinder-84614 Jun 16 11:58:21.008597 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-5154eb76-e233-442c-8853-d270124cd790 req-40f0ca01-cb88-4a38-95ad-eab24d951430 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055290 Jun 16 11:58:21.009560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 147/286] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:21.017279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-010ae98f-4d7a-4f44-aab7-944045e65f52 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:21.018593 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-010ae98f-4d7a-4f44-aab7-944045e65f52 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:21.031074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-010ae98f-4d7a-4f44-aab7-944045e65f52 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:21.031576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-010ae98f-4d7a-4f44-aab7-944045e65f52 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:21.032576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-010ae98f-4d7a-4f44-aab7-944045e65f52 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:21.033209 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-010ae98f-4d7a-4f44-aab7-944045e65f52 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:21.308328 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-010ae98f-4d7a-4f44-aab7-944045e65f52 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:21.321796 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-010ae98f-4d7a-4f44-aab7-944045e65f52 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.311037 Jun 16 11:58:21.322457 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 148/287] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:21 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:21.346108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-876dc01b-aad8-4c66-b4dd-6a6d96c40e6d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:21.367943 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-876dc01b-aad8-4c66-b4dd-6a6d96c40e6d tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1761 microversion: 2.1 time: 0.409013 Jun 16 11:58:21.377819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 140/288] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:20 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1761 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:21.709080 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:21.709697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:21.721243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:21.721243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:21.721243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:21.721243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:21.876938 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:21.892662 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:21.896467 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:21.897899 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a66d9c76-5320-4438-8d60-03e29f472baa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.192641 Jun 16 11:58:21.898653 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 149/289] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:21 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:22.338918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-eb164ca0-806a-4505-aff1-8a1fd719067f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:22.340051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-eb164ca0-806a-4505-aff1-8a1fd719067f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:22.347438 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eb164ca0-806a-4505-aff1-8a1fd719067f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.347913 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eb164ca0-806a-4505-aff1-8a1fd719067f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.348664 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eb164ca0-806a-4505-aff1-8a1fd719067f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.349089 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eb164ca0-806a-4505-aff1-8a1fd719067f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.523189 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-eb164ca0-806a-4505-aff1-8a1fd719067f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:22.532435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-eb164ca0-806a-4505-aff1-8a1fd719067f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1502 microversion: 2.1 time: 0.197380 Jun 16 11:58:22.536133 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 141/290] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:22 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:22.549565 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d1c9760-ff33-4b6b-8509-905b9f720556"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:22.550674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:22.557378 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.557822 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.558620 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.559047 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.581824 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] HTTP exception thrown: Cannot 'attach_volume' instance 8294f9b2-7466-4a10-b810-dcc3515bb498 while it is in vm_state rescued Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Request method failure captured: Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: POST /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498/os-volume_attachments HTTP/1.1 Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 74 Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpc5yamDpiSB8f7OnESQ50cHNirlCnyBfPHjqjB2vSHropmWxfJeAbxensZSeje0UBxZtS1HNRcfksjlI8EJUoG4R3_riom8WCNK9__EeEp9jMVJvO38Uq6nurzXiWCO-8HNMoTEdxp17CohHT0K0EyN4HbiE1r6_iJ8WtFdSM9gGI Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 11:58:22.584182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 6cdd0a7f3f12414ea85ebffc9d531773 Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {"volumeAttachment": {"volumeId": "0d1c9760-ff33-4b6b-8509-905b9f720556"}} Jun 16 11:58:22.585688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Cannot 'attach_volume' instance 8294f9b2-7466-4a10-b810-dcc3515bb498 while it is in vm_state rescued Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'server_id': '8294f9b2-7466-4a10-b810-dcc3515bb498', 'body': {'volumeAttachment': {'volumeId': '0d1c9760-ff33-4b6b-8509-905b9f720556'}}} Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8294f9b2-7466-4a10-b810-dcc3515bb498 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:58:22.586541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8294f9b2-7466-4a10-b810-dcc3515bb498 while it is in vm_state rescued Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:58:22.588278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:58:22.590059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:58:22.590059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:58:22.590059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8294f9b2-7466-4a10-b810-dcc3515bb498 while it is in vm_state rescued Jun 16 11:58:22.590059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:58:22.590059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Returning 409 to user: Cannot 'attach_volume' instance 8294f9b2-7466-4a10-b810-dcc3515bb498 while it is in vm_state rescued {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:58:22.590059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ff7af306-94d0-4224-97ab-8d5adc259d7f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040355 Jun 16 11:58:22.590059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 150/291] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 11:58:22 2022] POST /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 11:58:22.596222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-52ba7d15-3863-47c5-b323-89b6f8c65f53 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:22.596754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-52ba7d15-3863-47c5-b323-89b6f8c65f53 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:22.607066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-52ba7d15-3863-47c5-b323-89b6f8c65f53 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.607066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-52ba7d15-3863-47c5-b323-89b6f8c65f53 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.607066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-52ba7d15-3863-47c5-b323-89b6f8c65f53 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.607066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-52ba7d15-3863-47c5-b323-89b6f8c65f53 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.825386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-52ba7d15-3863-47c5-b323-89b6f8c65f53 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498/action" status: 202 len: 0 microversion: 2.1 time: 0.233211 Jun 16 11:58:22.826074 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 142/292] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:58:22 2022] POST /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 11:58:22.834367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-235d8ad1-de73-424f-9400-fb6b292f903b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:22.835300 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-235d8ad1-de73-424f-9400-fb6b292f903b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:22.847105 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-235d8ad1-de73-424f-9400-fb6b292f903b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.848025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-235d8ad1-de73-424f-9400-fb6b292f903b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.848800 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-235d8ad1-de73-424f-9400-fb6b292f903b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.849227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-235d8ad1-de73-424f-9400-fb6b292f903b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.917130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:22.918381 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:22.925794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.926240 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:22.927198 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:22.927664 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:23.017608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-235d8ad1-de73-424f-9400-fb6b292f903b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:23.027556 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-235d8ad1-de73-424f-9400-fb6b292f903b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1510 microversion: 2.1 time: 0.196732 Jun 16 11:58:23.029086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 151/293] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:22 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:23.210692 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:23.220988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:23.222527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:23.223690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5a673f63-040a-492b-87b5-91e5b7bb685f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.310756 Jun 16 11:58:23.224521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 143/294] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:22 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:24.046035 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-19eb7d9c-8fa0-40a3-9472-efda7a9591b2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:24.046634 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-19eb7d9c-8fa0-40a3-9472-efda7a9591b2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:24.053111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-19eb7d9c-8fa0-40a3-9472-efda7a9591b2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:24.053546 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-19eb7d9c-8fa0-40a3-9472-efda7a9591b2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:24.054295 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-19eb7d9c-8fa0-40a3-9472-efda7a9591b2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:24.054724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-19eb7d9c-8fa0-40a3-9472-efda7a9591b2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:24.183961 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-19eb7d9c-8fa0-40a3-9472-efda7a9591b2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:24.191398 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-19eb7d9c-8fa0-40a3-9472-efda7a9591b2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1510 microversion: 2.1 time: 0.149798 Jun 16 11:58:24.192191 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 152/295] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:24 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:24.241783 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:24.242381 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:24.249131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:24.249567 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:24.250317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:24.250739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:24.396175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:24.404875 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:24.406392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:24.407711 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b17e670d-c107-431c-baf3-3e83523f1879 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.169749 Jun 16 11:58:24.408297 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 144/296] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:24 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:25.208337 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-24bca1e0-2077-453e-8cb4-80d4ee373fc0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:25.208940 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-24bca1e0-2077-453e-8cb4-80d4ee373fc0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:25.215317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-24bca1e0-2077-453e-8cb4-80d4ee373fc0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:25.215759 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-24bca1e0-2077-453e-8cb4-80d4ee373fc0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:25.216561 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-24bca1e0-2077-453e-8cb4-80d4ee373fc0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:25.216995 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-24bca1e0-2077-453e-8cb4-80d4ee373fc0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:25.342182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-24bca1e0-2077-453e-8cb4-80d4ee373fc0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:25.349806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-24bca1e0-2077-453e-8cb4-80d4ee373fc0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1510 microversion: 2.1 time: 0.145297 Jun 16 11:58:25.350358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 153/297] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:25 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:25.425844 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:25.426451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:25.432944 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:25.433392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:25.434141 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:25.434570 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:25.560481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:25.568964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:25.570600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:25.571831 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-06d1f3b7-0aaf-4810-9832-c3b2593e6220 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.149891 Jun 16 11:58:25.572473 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 145/298] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:25 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:26.367079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-37cade74-e77f-4bfd-b76d-01745cdb1de1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:26.367678 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-37cade74-e77f-4bfd-b76d-01745cdb1de1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:26.374494 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-37cade74-e77f-4bfd-b76d-01745cdb1de1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:26.374936 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-37cade74-e77f-4bfd-b76d-01745cdb1de1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:26.375688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-37cade74-e77f-4bfd-b76d-01745cdb1de1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:26.376138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-37cade74-e77f-4bfd-b76d-01745cdb1de1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:26.504237 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-37cade74-e77f-4bfd-b76d-01745cdb1de1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:26.511654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-37cade74-e77f-4bfd-b76d-01745cdb1de1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1510 microversion: 2.1 time: 0.148387 Jun 16 11:58:26.512324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 154/299] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:26 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:26.588964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:26.589574 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:26.596400 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:26.596845 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:26.597605 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:26.598038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:26.727679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:26.736212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:26.737699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:26.738842 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5d251748-e61d-4a31-9cba-9312a9953f0f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.153780 Jun 16 11:58:26.739402 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 146/300] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:26 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:27.528451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-444c1ca1-bc14-424f-91cc-9afa9e964723 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:27.529062 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-444c1ca1-bc14-424f-91cc-9afa9e964723 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:27.535537 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-444c1ca1-bc14-424f-91cc-9afa9e964723 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:27.536072 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-444c1ca1-bc14-424f-91cc-9afa9e964723 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:27.536781 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-444c1ca1-bc14-424f-91cc-9afa9e964723 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:27.537214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-444c1ca1-bc14-424f-91cc-9afa9e964723 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:27.698175 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-444c1ca1-bc14-424f-91cc-9afa9e964723 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:27.706312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-444c1ca1-bc14-424f-91cc-9afa9e964723 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1510 microversion: 2.1 time: 0.182516 Jun 16 11:58:27.706871 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 155/301] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:27 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:27.757818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:27.758417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:27.765516 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:27.766140 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:27.766889 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:27.767525 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:27.897173 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:27.905208 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:27.906697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:27.907898 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3a667d86-8d58-4355-853c-123a18686046 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.153920 Jun 16 11:58:27.908456 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 147/302] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:27 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:28.723394 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3b9090e4-a633-4932-b535-349cb91b2d44 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:28.724587 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3b9090e4-a633-4932-b535-349cb91b2d44 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:28.732424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b9090e4-a633-4932-b535-349cb91b2d44 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:28.733214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b9090e4-a633-4932-b535-349cb91b2d44 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:28.734033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b9090e4-a633-4932-b535-349cb91b2d44 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:28.734543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b9090e4-a633-4932-b535-349cb91b2d44 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:28.874710 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3b9090e4-a633-4932-b535-349cb91b2d44 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:28.881999 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3b9090e4-a633-4932-b535-349cb91b2d44 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1510 microversion: 2.1 time: 0.163606 Jun 16 11:58:28.882565 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 156/303] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:28 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:28.926524 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:28.927113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:28.933895 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:28.934333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:28.935100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:28.935528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:29.080087 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:29.087917 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:29.089428 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:29.090572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-326db1c1-e671-4e2e-aba4-352f7792ba02 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.167965 Jun 16 11:58:29.091130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 148/304] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:28 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:29.703794 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-aae532df-d16c-4ec3-9df1-e452abfc8fe2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:29.710037 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-aae532df-d16c-4ec3-9df1-e452abfc8fe2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:29.710483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-aae532df-d16c-4ec3-9df1-e452abfc8fe2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:29.770580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-aae532df-d16c-4ec3-9df1-e452abfc8fe2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Going to try to stop instance {{(pid=125054) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 11:58:29.899099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-939eec4e-eaf4-4756-894e-6bece2f38d81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:29.899698 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-939eec4e-eaf4-4756-894e-6bece2f38d81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:29.906187 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-939eec4e-eaf4-4756-894e-6bece2f38d81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:29.906629 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-939eec4e-eaf4-4756-894e-6bece2f38d81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:29.907380 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-939eec4e-eaf4-4756-894e-6bece2f38d81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:29.907806 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-939eec4e-eaf4-4756-894e-6bece2f38d81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:29.954191 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-aae532df-d16c-4ec3-9df1-e452abfc8fe2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/action" status: 202 len: 0 microversion: 2.1 time: 0.254105 Jun 16 11:58:29.954784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 157/305] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:58:29 2022] POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 11:58:29.962864 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-dcb2efee-833d-4f41-9ad2-1ccac4f4bcc5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:29.963549 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-dcb2efee-833d-4f41-9ad2-1ccac4f4bcc5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:29.970580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dcb2efee-833d-4f41-9ad2-1ccac4f4bcc5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:29.971027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dcb2efee-833d-4f41-9ad2-1ccac4f4bcc5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:29.971794 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dcb2efee-833d-4f41-9ad2-1ccac4f4bcc5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:29.972262 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dcb2efee-833d-4f41-9ad2-1ccac4f4bcc5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:30.038524 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-939eec4e-eaf4-4756-894e-6bece2f38d81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:30.046487 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-939eec4e-eaf4-4756-894e-6bece2f38d81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1516 microversion: 2.1 time: 0.151140 Jun 16 11:58:30.047046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 149/306] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:29 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:30.109637 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:30.110245 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:30.116707 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:30.117144 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:30.117916 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:30.118526 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:30.277737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:30.280104 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:30.290795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:30.290795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:30.290795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-beba5be1-1cf6-4528-8272-7fa9e8ca45ea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.184690 Jun 16 11:58:30.291511 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 150/307] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:30 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:58:30.324036 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-dcb2efee-833d-4f41-9ad2-1ccac4f4bcc5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:30.330247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-dcb2efee-833d-4f41-9ad2-1ccac4f4bcc5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.371312 Jun 16 11:58:30.330804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 158/308] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:29 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:31.308999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:31.309626 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:31.316763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:31.317201 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:31.317951 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:31.318378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:31.348410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-645a9299-dbaf-4f06-bed7-ec2a49697b46 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:31.349103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-645a9299-dbaf-4f06-bed7-ec2a49697b46 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:31.356303 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-645a9299-dbaf-4f06-bed7-ec2a49697b46 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:31.361168 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-645a9299-dbaf-4f06-bed7-ec2a49697b46 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:31.361168 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-645a9299-dbaf-4f06-bed7-ec2a49697b46 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:31.361168 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-645a9299-dbaf-4f06-bed7-ec2a49697b46 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:31.450564 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:31.458418 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:31.460171 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:31.461315 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0439ef20-f7ed-4b22-a53e-50deb2454572 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.156210 Jun 16 11:58:31.471976 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 151/309] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:31 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:31.484733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-645a9299-dbaf-4f06-bed7-ec2a49697b46 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:31.493042 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-645a9299-dbaf-4f06-bed7-ec2a49697b46 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.148387 Jun 16 11:58:31.493596 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 159/310] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:31 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:32.480655 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:32.481174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:32.487805 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:32.488301 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:32.489086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:32.489514 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:32.510387 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-63bda3a2-2c1a-4cb3-8eb2-f35abed58c48 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:32.511035 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-63bda3a2-2c1a-4cb3-8eb2-f35abed58c48 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:32.517414 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-63bda3a2-2c1a-4cb3-8eb2-f35abed58c48 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:32.517849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-63bda3a2-2c1a-4cb3-8eb2-f35abed58c48 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:32.518599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-63bda3a2-2c1a-4cb3-8eb2-f35abed58c48 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:32.519027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-63bda3a2-2c1a-4cb3-8eb2-f35abed58c48 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:32.625970 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:32.634309 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:32.635848 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:32.637007 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-630d9b15-8612-454a-9e9d-f09d6dccbeb7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.160783 Jun 16 11:58:32.637556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 152/311] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:32 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:32.644166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-63bda3a2-2c1a-4cb3-8eb2-f35abed58c48 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:32.652063 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-63bda3a2-2c1a-4cb3-8eb2-f35abed58c48 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.145440 Jun 16 11:58:32.652620 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 160/312] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:32 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:33.655450 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:33.656025 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:33.662199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:33.662636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:33.663404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:33.663924 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:33.669032 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0355cf25-69f1-4aa1-add9-d215486db0d5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:33.669649 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0355cf25-69f1-4aa1-add9-d215486db0d5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:33.679441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0355cf25-69f1-4aa1-add9-d215486db0d5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:33.679441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0355cf25-69f1-4aa1-add9-d215486db0d5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:33.679441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0355cf25-69f1-4aa1-add9-d215486db0d5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:33.679441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0355cf25-69f1-4aa1-add9-d215486db0d5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:33.812905 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:33.818773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0355cf25-69f1-4aa1-add9-d215486db0d5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:33.821662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:33.823805 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:33.825027 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7c34d013-422a-476a-99cb-fd9d167b758f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.173655 Jun 16 11:58:33.825581 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 153/313] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:33 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:33.827365 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0355cf25-69f1-4aa1-add9-d215486db0d5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.162104 Jun 16 11:58:33.828098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 161/314] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:33 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:33.830431 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9f1501ec-cf58-4f1e-af90-b8edc4de476a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'create', calling method: .version_select at 0x7f43344ebdc0>, body: {"keypair": {"name": "tempest-keypair-1428049835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxbTU+qWdGUpLEzilG13bxM/jx1beaPbXuAKKV+uRjYQ5I38ihRhgU81FcqSJuozR1Y4h5BQM4No+m2pl1SJYAspnmiUgtpd54FI1TE1D8csfzYRf7el0mDubjPrNtdmQ=="}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:33.844843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-9f1501ec-cf58-4f1e-af90-b8edc4de476a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Getting quotas for project ce5409289ccf4aad8d62b13a72d0009e. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:58:33.848591 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-9f1501ec-cf58-4f1e-af90-b8edc4de476a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Getting quotas for user 6cdd0a7f3f12414ea85ebffc9d531773 and project ce5409289ccf4aad8d62b13a72d0009e. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:58:33.951952 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9f1501ec-cf58-4f1e-af90-b8edc4de476a tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125311 Jun 16 11:58:33.952576 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 154/315] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 11:58:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:34.844690 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b440e453-cbcb-43f8-8f87-f2c515af8ff5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:34.849863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b440e453-cbcb-43f8-8f87-f2c515af8ff5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:34.849990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:34.849990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:34.852636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b440e453-cbcb-43f8-8f87-f2c515af8ff5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:34.853086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b440e453-cbcb-43f8-8f87-f2c515af8ff5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:34.853865 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b440e453-cbcb-43f8-8f87-f2c515af8ff5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:34.854297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b440e453-cbcb-43f8-8f87-f2c515af8ff5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:34.855411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:34.855857 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:34.856685 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:34.857126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:34.992510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:35.001088 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:35.002587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:35.003774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1999f698-39ac-4f6e-bf4c-076f369b1391 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1744 microversion: 2.20 time: 0.163210 Jun 16 11:58:35.004437 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 155/316] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:34 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:35.015766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b440e453-cbcb-43f8-8f87-f2c515af8ff5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:35.021472 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:35.026056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b440e453-cbcb-43f8-8f87-f2c515af8ff5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.186179 Jun 16 11:58:35.026957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 162/317] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:34 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:36.022439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:36.023798 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:36.036889 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:36.037328 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:36.038274 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:36.038879 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:36.043945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f1278833-f395-408a-9578-6e4a2d2ad8bd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:36.044557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f1278833-f395-408a-9578-6e4a2d2ad8bd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:36.052425 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1278833-f395-408a-9578-6e4a2d2ad8bd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:36.052922 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1278833-f395-408a-9578-6e4a2d2ad8bd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:36.053700 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1278833-f395-408a-9578-6e4a2d2ad8bd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:36.054129 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1278833-f395-408a-9578-6e4a2d2ad8bd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:36.205119 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:36.215801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:36.216363 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:36.218075 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ba2321b8-5da8-48e8-b1a7-b403596f6fe2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1744 microversion: 2.20 time: 0.199404 Jun 16 11:58:36.219627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 156/318] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:36 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1744 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:36.290159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f1278833-f395-408a-9578-6e4a2d2ad8bd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:36.303212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f1278833-f395-408a-9578-6e4a2d2ad8bd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.263719 Jun 16 11:58:36.304238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 163/319] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:36 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:36.727723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-925501722", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "950be268-f975-4428-bdc1-84f1abeb0a4f"}], "security_groups": [{"name": "tempest-securitygroup--1491597779"}], "key_name": "tempest-keypair-1428049835", "user_data": "}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:36.830275 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] validate_networks() for [('950be268-f975-4428-bdc1-84f1abeb0a4f', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:58:37.238110 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:37.239935 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:37.260162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:37.260609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:37.261443 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:37.261805 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:37.274667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:58:37.275079 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:58:37.275547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:58:37.276012 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:58:37.279116 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:58:37.288340 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:37.288866 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:37.289677 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:37.290106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:37.309957 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Getting quotas for project ce5409289ccf4aad8d62b13a72d0009e. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:58:37.314027 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Getting quotas for user 6cdd0a7f3f12414ea85ebffc9d531773 and project ce5409289ccf4aad8d62b13a72d0009e. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:58:37.327108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:58:37.329505 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:58:37.490755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:37.498690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7b0d5eed-f277-4728-896b-97eb5cf808b3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.775258 Jun 16 11:58:37.500092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 157/320] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:58:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 11:58:37.504546 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:37.508764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:37.510320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9658cc9e-a85d-48d8-b174-4c7e20e9f464 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.276313 Jun 16 11:58:37.511950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 164/321] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:37 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:37.512923 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5a61c42e-d6cf-4657-9cdf-cc2055d0128b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:37.513555 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5a61c42e-d6cf-4657-9cdf-cc2055d0128b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:37.520205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-be6ce2c3-4a7d-4371-ad63-0edbea1b4bda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:37.522237 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-be6ce2c3-4a7d-4371-ad63-0edbea1b4bda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:37.529129 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a61c42e-d6cf-4657-9cdf-cc2055d0128b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:37.529841 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a61c42e-d6cf-4657-9cdf-cc2055d0128b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:37.530805 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a61c42e-d6cf-4657-9cdf-cc2055d0128b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:37.536734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a61c42e-d6cf-4657-9cdf-cc2055d0128b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:37.612252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-be6ce2c3-4a7d-4371-ad63-0edbea1b4bda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:37.621086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-be6ce2c3-4a7d-4371-ad63-0edbea1b4bda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1245 microversion: 2.1 time: 0.107419 Jun 16 11:58:37.630038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 165/322] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:37 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1245 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:37.735224 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5a61c42e-d6cf-4657-9cdf-cc2055d0128b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:37.744095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5a61c42e-d6cf-4657-9cdf-cc2055d0128b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.242700 Jun 16 11:58:37.745229 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 158/323] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:37 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:38.467507 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-40637ebd-0cab-44cd-b1a8-c5db61be0a39 req-953d183e-2d97-4123-8009-80fcb3b7c83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6646f09a-70e9-487b-98f0-89ab1fe5508a", "name": "network-vif-plugged", "status": "completed", "tag": "e8a94066-1a49-45d0-9264-0c1a6dbdacde"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:38.486098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-40637ebd-0cab-44cd-b1a8-c5db61be0a39 req-953d183e-2d97-4123-8009-80fcb3b7c83f service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:38.486744 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-40637ebd-0cab-44cd-b1a8-c5db61be0a39 req-953d183e-2d97-4123-8009-80fcb3b7c83f service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:38.497822 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-40637ebd-0cab-44cd-b1a8-c5db61be0a39 req-953d183e-2d97-4123-8009-80fcb3b7c83f service nova] Creating event network-vif-plugged:e8a94066-1a49-45d0-9264-0c1a6dbdacde for instance 6646f09a-70e9-487b-98f0-89ab1fe5508a on hv-cinder-84614 Jun 16 11:58:38.503264 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-40637ebd-0cab-44cd-b1a8-c5db61be0a39 req-953d183e-2d97-4123-8009-80fcb3b7c83f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039866 Jun 16 11:58:38.503982 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 166/324] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:38.531358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:38.532125 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:38.541639 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:38.542865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:38.545299 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:38.545299 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:38.647753 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-413d51b6-9bf1-4a6b-a5a1-6ae243b3ffd2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:38.648590 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-413d51b6-9bf1-4a6b-a5a1-6ae243b3ffd2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:38.782521 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-413d51b6-9bf1-4a6b-a5a1-6ae243b3ffd2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:38.797492 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-413d51b6-9bf1-4a6b-a5a1-6ae243b3ffd2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1245 microversion: 2.1 time: 0.149189 Jun 16 11:58:38.797492 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 167/325] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:38 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1245 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:38.854143 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f4ad990f-7de6-4a15-b9af-30399d1f2300 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:38.865931 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f4ad990f-7de6-4a15-b9af-30399d1f2300 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:39.059839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f4ad990f-7de6-4a15-b9af-30399d1f2300 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:39.059839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f4ad990f-7de6-4a15-b9af-30399d1f2300 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:39.059839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f4ad990f-7de6-4a15-b9af-30399d1f2300 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:39.059839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f4ad990f-7de6-4a15-b9af-30399d1f2300 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:39.065247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:39.065247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:39.065672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:39.065672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f89171a9-5416-4400-92e3-3a7d1a1f3f57 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.411538 Jun 16 11:58:39.065672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 159/326] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:38 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:39.071142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f4ad990f-7de6-4a15-b9af-30399d1f2300 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:39.082648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f4ad990f-7de6-4a15-b9af-30399d1f2300 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.287298 Jun 16 11:58:39.083464 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 168/327] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:38 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:39.809064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d2a8a881-3ebb-4990-95c5-9ebe2afda03e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:39.809661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d2a8a881-3ebb-4990-95c5-9ebe2afda03e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:39.817930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d2a8a881-3ebb-4990-95c5-9ebe2afda03e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:39.822714 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d2a8a881-3ebb-4990-95c5-9ebe2afda03e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:39.824527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d2a8a881-3ebb-4990-95c5-9ebe2afda03e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:39.825602 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d2a8a881-3ebb-4990-95c5-9ebe2afda03e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:39.942290 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d2a8a881-3ebb-4990-95c5-9ebe2afda03e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:39.951163 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d2a8a881-3ebb-4990-95c5-9ebe2afda03e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1241 microversion: 2.1 time: 0.145878 Jun 16 11:58:39.951765 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 160/328] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:39 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1241 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:40.056245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:40.056877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:40.064742 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:40.065182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:40.066267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:40.066705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:40.108555 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c35cd36b-2cb0-4564-b0d7-227da409538a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:40.109645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c35cd36b-2cb0-4564-b0d7-227da409538a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:40.122241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c35cd36b-2cb0-4564-b0d7-227da409538a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:40.124149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c35cd36b-2cb0-4564-b0d7-227da409538a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:40.126841 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c35cd36b-2cb0-4564-b0d7-227da409538a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:40.131580 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c35cd36b-2cb0-4564-b0d7-227da409538a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:40.250640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:40.266772 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:40.268611 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:40.271451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-673e6515-7ee2-49ad-bbd9-b3f351ad5d13 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.219406 Jun 16 11:58:40.284767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 169/329] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:40 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:40.365547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c35cd36b-2cb0-4564-b0d7-227da409538a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:40.380441 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c35cd36b-2cb0-4564-b0d7-227da409538a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.277599 Jun 16 11:58:40.387025 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 161/330] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:40 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:40.969134 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f618da61-0f6a-4941-8c3c-88d411be1c9d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:40.970312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f618da61-0f6a-4941-8c3c-88d411be1c9d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:40.979150 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f618da61-0f6a-4941-8c3c-88d411be1c9d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:40.988900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f618da61-0f6a-4941-8c3c-88d411be1c9d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:40.988900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f618da61-0f6a-4941-8c3c-88d411be1c9d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:40.988900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f618da61-0f6a-4941-8c3c-88d411be1c9d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:41.088680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f618da61-0f6a-4941-8c3c-88d411be1c9d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:41.097112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f618da61-0f6a-4941-8c3c-88d411be1c9d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1315 microversion: 2.1 time: 0.132698 Jun 16 11:58:41.097930 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 170/331] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:40 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1315 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:41.294611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:41.295260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:41.301926 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:41.302365 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:41.303118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:41.303602 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:41.403965 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-95e718cd-cf26-4793-9743-8482a776282f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:41.405215 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-95e718cd-cf26-4793-9743-8482a776282f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:41.408796 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=70 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:41.413606 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-95e718cd-cf26-4793-9743-8482a776282f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:41.415169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-95e718cd-cf26-4793-9743-8482a776282f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:41.416193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-95e718cd-cf26-4793-9743-8482a776282f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:41.416643 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-95e718cd-cf26-4793-9743-8482a776282f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:41.641505 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:41.650758 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:41.662623 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:41.672433 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d619d8a3-5f80-4db7-9522-cbb6dfe1cb3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.370125 Jun 16 11:58:41.673187 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 162/332] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:41 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:41.743113 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-95e718cd-cf26-4793-9743-8482a776282f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:41.753824 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-95e718cd-cf26-4793-9743-8482a776282f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.353897 Jun 16 11:58:41.754909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 171/333] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:41 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:42.119382 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-87f532f4-c0c7-4b73-8b3b-24536e78fc8f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:42.120030 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-87f532f4-c0c7-4b73-8b3b-24536e78fc8f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:42.132682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-87f532f4-c0c7-4b73-8b3b-24536e78fc8f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:42.132682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-87f532f4-c0c7-4b73-8b3b-24536e78fc8f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:42.132682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-87f532f4-c0c7-4b73-8b3b-24536e78fc8f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:42.132682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-87f532f4-c0c7-4b73-8b3b-24536e78fc8f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:42.566058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-87f532f4-c0c7-4b73-8b3b-24536e78fc8f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:42.576319 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-87f532f4-c0c7-4b73-8b3b-24536e78fc8f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.463583 Jun 16 11:58:42.585882 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 163/334] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:42 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:42.695642 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:42.696363 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:42.707724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:42.708242 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:42.709052 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:42.709512 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:42.771539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e7e9576f-7b4b-419c-a8fa-de9aa19ed5ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:42.772164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e7e9576f-7b4b-419c-a8fa-de9aa19ed5ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:42.788929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e7e9576f-7b4b-419c-a8fa-de9aa19ed5ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:42.789386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e7e9576f-7b4b-419c-a8fa-de9aa19ed5ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:42.793795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e7e9576f-7b4b-419c-a8fa-de9aa19ed5ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:42.793795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e7e9576f-7b4b-419c-a8fa-de9aa19ed5ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:43.008132 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:43.026617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:43.026617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:43.028398 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ae048f2b-1fab-4d98-86ea-2ea143a5937a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.339765 Jun 16 11:58:43.042746 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 172/335] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:42 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:58:43.228533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e7e9576f-7b4b-419c-a8fa-de9aa19ed5ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:43.236706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e7e9576f-7b4b-419c-a8fa-de9aa19ed5ed tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.469281 Jun 16 11:58:43.247641 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 164/336] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:42 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:43.594805 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7e22beed-5727-4036-81c8-4c6d46ff2f08 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:43.595808 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7e22beed-5727-4036-81c8-4c6d46ff2f08 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:43.611718 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7e22beed-5727-4036-81c8-4c6d46ff2f08 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:43.612816 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7e22beed-5727-4036-81c8-4c6d46ff2f08 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:43.615983 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7e22beed-5727-4036-81c8-4c6d46ff2f08 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:43.616814 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7e22beed-5727-4036-81c8-4c6d46ff2f08 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:43.934381 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7e22beed-5727-4036-81c8-4c6d46ff2f08 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:43.944390 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7e22beed-5727-4036-81c8-4c6d46ff2f08 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.355044 Jun 16 11:58:43.945707 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 173/337] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:43 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:44.051578 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:44.052236 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:44.058978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:44.060779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:44.061287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:44.062358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:44.062999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:44.259421 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-40f70d68-ecba-4dfa-b0ed-5f758916e99e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:44.259421 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-40f70d68-ecba-4dfa-b0ed-5f758916e99e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:44.272530 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-40f70d68-ecba-4dfa-b0ed-5f758916e99e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:44.294065 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-40f70d68-ecba-4dfa-b0ed-5f758916e99e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:44.294065 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-40f70d68-ecba-4dfa-b0ed-5f758916e99e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:44.294065 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-40f70d68-ecba-4dfa-b0ed-5f758916e99e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:44.337879 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:44.362005 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:44.376677 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:44.388357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e202b018-1798-43fc-a751-1e74f3e21c39 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.340676 Jun 16 11:58:44.389054 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 165/338] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:44 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:44.404283 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-19ccb1ce-4e90-416b-b637-485a6e78add2 req-24f314f9-0e86-44c1-8f83-19b7edd51bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c202b5a-d86c-445a-9119-9b0893b15c1f", "tag": "f40c01cc-1a91-4c00-ac75-2e413104f6db"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:44.420096 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-19ccb1ce-4e90-416b-b637-485a6e78add2 req-24f314f9-0e86-44c1-8f83-19b7edd51bb3 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:44.425479 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-19ccb1ce-4e90-416b-b637-485a6e78add2 req-24f314f9-0e86-44c1-8f83-19b7edd51bb3 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:44.452331 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-19ccb1ce-4e90-416b-b637-485a6e78add2 req-24f314f9-0e86-44c1-8f83-19b7edd51bb3 service nova] Creating event network-changed:f40c01cc-1a91-4c00-ac75-2e413104f6db for instance 5c202b5a-d86c-445a-9119-9b0893b15c1f on hv-cinder-84614 Jun 16 11:58:44.461351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-19ccb1ce-4e90-416b-b637-485a6e78add2 req-24f314f9-0e86-44c1-8f83-19b7edd51bb3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070985 Jun 16 11:58:44.462297 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 166/339] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:44.664347 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-40f70d68-ecba-4dfa-b0ed-5f758916e99e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:44.695519 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-40f70d68-ecba-4dfa-b0ed-5f758916e99e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.444189 Jun 16 11:58:44.698734 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 174/340] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:44 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:44.962368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f27695d4-8ea8-49c6-8e0d-24aa188576d2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:44.963852 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f27695d4-8ea8-49c6-8e0d-24aa188576d2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:44.976292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f27695d4-8ea8-49c6-8e0d-24aa188576d2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:44.976663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f27695d4-8ea8-49c6-8e0d-24aa188576d2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:44.980059 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f27695d4-8ea8-49c6-8e0d-24aa188576d2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:44.981297 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f27695d4-8ea8-49c6-8e0d-24aa188576d2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:45.246169 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f27695d4-8ea8-49c6-8e0d-24aa188576d2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:45.260042 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f27695d4-8ea8-49c6-8e0d-24aa188576d2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.301965 Jun 16 11:58:45.261356 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 167/341] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:44 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:45.413212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:45.414596 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:45.431014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:45.431654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:45.433317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:45.434539 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:45.667904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:45.678038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:45.683264 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:45.684925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-70e1c740-a7f4-4fa1-9fbd-cd0015b4a5d4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.276087 Jun 16 11:58:45.685959 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 175/342] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:45 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:45.722283 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6b2a2c69-ab21-470b-bfd9-3bde7af67a4e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:45.722909 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6b2a2c69-ab21-470b-bfd9-3bde7af67a4e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:45.731334 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6b2a2c69-ab21-470b-bfd9-3bde7af67a4e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:45.732846 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6b2a2c69-ab21-470b-bfd9-3bde7af67a4e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:45.734995 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6b2a2c69-ab21-470b-bfd9-3bde7af67a4e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:45.734995 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6b2a2c69-ab21-470b-bfd9-3bde7af67a4e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:45.931684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6b2a2c69-ab21-470b-bfd9-3bde7af67a4e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:45.941972 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6b2a2c69-ab21-470b-bfd9-3bde7af67a4e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.226492 Jun 16 11:58:45.952879 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 168/343] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:45 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:46.277493 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f4205f3e-16b9-482c-8778-720632460e81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:46.278094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f4205f3e-16b9-482c-8778-720632460e81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:46.284740 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f4205f3e-16b9-482c-8778-720632460e81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:46.285188 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f4205f3e-16b9-482c-8778-720632460e81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:46.285945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f4205f3e-16b9-482c-8778-720632460e81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:46.286395 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f4205f3e-16b9-482c-8778-720632460e81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:46.432042 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f4205f3e-16b9-482c-8778-720632460e81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:46.458980 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f4205f3e-16b9-482c-8778-720632460e81 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.185737 Jun 16 11:58:46.479594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 176/344] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:46 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:46.705802 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:46.707112 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:46.717632 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:46.720191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:46.723143 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:46.723791 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:46.961374 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e0dcc474-24db-40a3-b152-996d4fe08292 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:46.962263 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e0dcc474-24db-40a3-b152-996d4fe08292 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:46.984976 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e0dcc474-24db-40a3-b152-996d4fe08292 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:46.985672 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e0dcc474-24db-40a3-b152-996d4fe08292 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:46.986624 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e0dcc474-24db-40a3-b152-996d4fe08292 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:46.987216 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e0dcc474-24db-40a3-b152-996d4fe08292 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:47.087383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:47.093697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=100 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:47.108973 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:47.111458 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:47.116100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6d08c583-eacc-49c7-8214-8d6f20e1924f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.413975 Jun 16 11:58:47.118653 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 169/345] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:46 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:47.236529 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e0dcc474-24db-40a3-b152-996d4fe08292 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:47.244410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e0dcc474-24db-40a3-b152-996d4fe08292 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.287327 Jun 16 11:58:47.255001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 177/346] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:46 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:47.477588 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-801c016d-745c-4b30-98d6-742b76fb71d3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:47.478511 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-801c016d-745c-4b30-98d6-742b76fb71d3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:47.487241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:47.488667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=10 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:47.491756 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-801c016d-745c-4b30-98d6-742b76fb71d3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:47.493175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-801c016d-745c-4b30-98d6-742b76fb71d3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:47.493962 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-801c016d-745c-4b30-98d6-742b76fb71d3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:47.494397 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-801c016d-745c-4b30-98d6-742b76fb71d3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:47.521332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-222891150", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "networks": [{"uuid": "4945d533-61d1-4e27-8c6c-6c8c92bbcce5"}]}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:47.592370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] validate_networks() for [('4945d533-61d1-4e27-8c6c-6c8c92bbcce5', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:58:47.652599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-801c016d-745c-4b30-98d6-742b76fb71d3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:47.661021 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-801c016d-745c-4b30-98d6-742b76fb71d3 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.187207 Jun 16 11:58:47.671292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 170/347] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:47 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:48.047150 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:58:48.047813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:58:48.048306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:58:48.048709 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:58:48.049111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:58:48.061095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:48.061907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:48.063312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:48.063926 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:48.097360 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Getting quotas for project 1c8858f51824444782c874f15da7b16b. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:58:48.097360 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Getting quotas for user 9082354c3ab249f885e129b86799e508 and project 1c8858f51824444782c874f15da7b16b. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:58:48.106363 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:58:48.108996 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:58:48.139519 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:48.141406 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:48.153197 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:48.154110 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:48.158046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:48.159740 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:48.287814 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b26ff7ab-cd89-41b9-9b13-928b7051daa1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770244 Jun 16 11:58:48.291504 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 178/348] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 11:58:48.301836 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f5877ba9-ca77-4805-b4b8-312df516121c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:48.302809 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f5877ba9-ca77-4805-b4b8-312df516121c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:48.314801 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5877ba9-ca77-4805-b4b8-312df516121c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:48.316402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5877ba9-ca77-4805-b4b8-312df516121c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:48.317432 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5877ba9-ca77-4805-b4b8-312df516121c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:48.318083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5877ba9-ca77-4805-b4b8-312df516121c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:48.480326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:48.502341 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:48.503937 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:48.505132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-dcc1efe7-2ea6-476e-84f5-b325ce713088 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.370164 Jun 16 11:58:48.528188 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 171/349] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:48 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:58:48.532976 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-412115731", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:48.595421 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f5877ba9-ca77-4805-b4b8-312df516121c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:48.610024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f5877ba9-ca77-4805-b4b8-312df516121c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1726 microversion: 2.1 time: 0.317083 Jun 16 11:58:48.613627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 179/350] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:48 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1726 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:48.621450 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9f443689-f6da-4491-9220-e225256faad4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:48.621450 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9f443689-f6da-4491-9220-e225256faad4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:48.627164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] validate_networks() for None {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:58:48.733326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9f443689-f6da-4491-9220-e225256faad4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:48.743154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9f443689-f6da-4491-9220-e225256faad4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1213 microversion: 2.1 time: 0.128774 Jun 16 11:58:48.755320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 180/351] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:48 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:48.764017 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c101a199-0440-44d8-9d89-332c527e6ba6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:48.765185 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c101a199-0440-44d8-9d89-332c527e6ba6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:48.773001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c101a199-0440-44d8-9d89-332c527e6ba6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:48.773819 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c101a199-0440-44d8-9d89-332c527e6ba6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:48.774790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c101a199-0440-44d8-9d89-332c527e6ba6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:48.775645 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c101a199-0440-44d8-9d89-332c527e6ba6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:48.944453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c101a199-0440-44d8-9d89-332c527e6ba6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:48.953723 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c101a199-0440-44d8-9d89-332c527e6ba6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.194892 Jun 16 11:58:48.954600 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 181/352] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:48 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:49.062326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:58:49.062743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:58:49.063631 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:58:49.064213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:58:49.064805 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:58:49.081307 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.082013 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:49.083066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.083426 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:49.103095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Getting quotas for project c6602646a8734415a2cd5c138ec99b29. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:58:49.108001 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Getting quotas for user e32560e5ffa640d0b505834f090bd330 and project c6602646a8734415a2cd5c138ec99b29. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:58:49.122787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:58:49.125666 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:58:49.267328 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d3ceb9f1-f08f-453d-974d-7eb56f7c6624 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738014 Jun 16 11:58:49.268040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 172/353] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 11:58:49.278632 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-735dcc67-10c6-424a-bb41-4baae0a690d6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:49.279468 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-735dcc67-10c6-424a-bb41-4baae0a690d6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:49.388235 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-735dcc67-10c6-424a-bb41-4baae0a690d6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:49.398853 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-735dcc67-10c6-424a-bb41-4baae0a690d6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1214 microversion: 2.1 time: 0.124508 Jun 16 11:58:49.399730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 182/354] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:49 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:49.524122 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:49.531397 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:49.538875 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.539526 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:49.540462 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.542240 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:49.632800 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b49120a9-6837-4b20-9c60-2f082a8e5dce tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:49.633996 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b49120a9-6837-4b20-9c60-2f082a8e5dce tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:49.645274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b49120a9-6837-4b20-9c60-2f082a8e5dce tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.645901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b49120a9-6837-4b20-9c60-2f082a8e5dce tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:49.646857 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b49120a9-6837-4b20-9c60-2f082a8e5dce tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.647440 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b49120a9-6837-4b20-9c60-2f082a8e5dce tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:49.776567 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:49.784639 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:49.800674 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:49.800674 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c30e25d5-a5ff-4602-9da4-b8382205c288 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.267395 Jun 16 11:58:49.801572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 173/355] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:49 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:49.815165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d7cd72aa-0ed8-4647-b1bd-d75cd5165db4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:49.816068 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d7cd72aa-0ed8-4647-b1bd-d75cd5165db4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:49.906586 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d7cd72aa-0ed8-4647-b1bd-d75cd5165db4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:49.914824 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d7cd72aa-0ed8-4647-b1bd-d75cd5165db4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1213 microversion: 2.1 time: 0.111588 Jun 16 11:58:49.917595 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 174/356] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:49 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:49.926786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b49120a9-6837-4b20-9c60-2f082a8e5dce tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:49.934997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b49120a9-6837-4b20-9c60-2f082a8e5dce tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1703 microversion: 2.1 time: 0.305811 Jun 16 11:58:49.942301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 183/357] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:49 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1703 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:49.952124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9ba800f9-67ee-4748-a616-c89f26ae22f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:49.958998 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9ba800f9-67ee-4748-a616-c89f26ae22f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.959359 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9ba800f9-67ee-4748-a616-c89f26ae22f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:49.971243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-01a213c1-4a5a-4ccb-957c-a42260e3c649 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:49.972282 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-01a213c1-4a5a-4ccb-957c-a42260e3c649 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:49.986173 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-01a213c1-4a5a-4ccb-957c-a42260e3c649 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.990332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-01a213c1-4a5a-4ccb-957c-a42260e3c649 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:49.991294 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-01a213c1-4a5a-4ccb-957c-a42260e3c649 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:49.991748 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-01a213c1-4a5a-4ccb-957c-a42260e3c649 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:50.031990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9ba800f9-67ee-4748-a616-c89f26ae22f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Going to try to start instance {{(pid=125055) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 11:58:50.240859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9ba800f9-67ee-4748-a616-c89f26ae22f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/action" status: 202 len: 0 microversion: 2.1 time: 0.292384 Jun 16 11:58:50.242745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 175/358] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:58:49 2022] POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 11:58:50.260914 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9c7ba973-53a3-4ff7-a63e-804445e9d858 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:50.265935 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-01a213c1-4a5a-4ccb-957c-a42260e3c649 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:50.266654 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9c7ba973-53a3-4ff7-a63e-804445e9d858 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:50.273864 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:50.279245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-01a213c1-4a5a-4ccb-957c-a42260e3c649 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.312585 Jun 16 11:58:50.280230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 184/359] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:49 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:50.290880 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9c7ba973-53a3-4ff7-a63e-804445e9d858 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:50.291447 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9c7ba973-53a3-4ff7-a63e-804445e9d858 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:50.292855 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9c7ba973-53a3-4ff7-a63e-804445e9d858 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:50.293324 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9c7ba973-53a3-4ff7-a63e-804445e9d858 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:50.418085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e4ec9724-0d0b-4489-96f2-10e7081c79a7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:50.419065 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e4ec9724-0d0b-4489-96f2-10e7081c79a7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:50.443162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9c7ba973-53a3-4ff7-a63e-804445e9d858 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:50.453118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9c7ba973-53a3-4ff7-a63e-804445e9d858 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1712 microversion: 2.1 time: 0.205178 Jun 16 11:58:50.454032 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 176/360] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:50 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1712 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:50.486711 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e4ec9724-0d0b-4489-96f2-10e7081c79a7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:50.493543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e4ec9724-0d0b-4489-96f2-10e7081c79a7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1214 microversion: 2.1 time: 0.079998 Jun 16 11:58:50.494098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 185/361] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:50 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:50.812966 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:50.813699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:50.830700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:50.833635 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:50.834737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:50.848425 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:50.942162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ebd33f47-1c12-4e90-968d-afdf7421b557 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:50.943496 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ebd33f47-1c12-4e90-968d-afdf7421b557 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:50.955566 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebd33f47-1c12-4e90-968d-afdf7421b557 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:50.956050 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebd33f47-1c12-4e90-968d-afdf7421b557 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:50.957626 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebd33f47-1c12-4e90-968d-afdf7421b557 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:50.958073 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebd33f47-1c12-4e90-968d-afdf7421b557 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:51.053873 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ebd33f47-1c12-4e90-968d-afdf7421b557 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:51.072733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ebd33f47-1c12-4e90-968d-afdf7421b557 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1209 microversion: 2.1 time: 0.141496 Jun 16 11:58:51.074203 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 186/362] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:50 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:51.078761 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-b791a2a3-3d91-471b-877c-cf6246063252 req-487fa34a-4f8f-49ac-9398-d2806856a1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c202b5a-d86c-445a-9119-9b0893b15c1f", "name": "network-vif-plugged", "status": "completed", "tag": "f40c01cc-1a91-4c00-ac75-2e413104f6db"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:51.087231 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-b791a2a3-3d91-471b-877c-cf6246063252 req-487fa34a-4f8f-49ac-9398-d2806856a1a0 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:51.087604 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-b791a2a3-3d91-471b-877c-cf6246063252 req-487fa34a-4f8f-49ac-9398-d2806856a1a0 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:51.100150 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-b791a2a3-3d91-471b-877c-cf6246063252 req-487fa34a-4f8f-49ac-9398-d2806856a1a0 service nova] Creating event network-vif-plugged:f40c01cc-1a91-4c00-ac75-2e413104f6db for instance 5c202b5a-d86c-445a-9119-9b0893b15c1f on hv-cinder-84614 Jun 16 11:58:51.105773 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:51.107623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-b791a2a3-3d91-471b-877c-cf6246063252 req-487fa34a-4f8f-49ac-9398-d2806856a1a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032167 Jun 16 11:58:51.108253 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 187/363] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:51.116903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:51.118390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:51.119550 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f7eb682d-def4-44d4-a9ee-f2cfb0bf8a35 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.310652 Jun 16 11:58:51.123723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 177/364] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:50 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:51.307612 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2d5ec0eb-95b5-4785-9930-0eb1800b0ede tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:51.308432 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2d5ec0eb-95b5-4785-9930-0eb1800b0ede tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:51.314978 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2d5ec0eb-95b5-4785-9930-0eb1800b0ede tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:51.315564 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2d5ec0eb-95b5-4785-9930-0eb1800b0ede tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:51.316401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2d5ec0eb-95b5-4785-9930-0eb1800b0ede tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:51.316869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2d5ec0eb-95b5-4785-9930-0eb1800b0ede tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:51.471047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-97315a21-164b-4927-a8fa-7f774ea0d0c7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:51.471752 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-97315a21-164b-4927-a8fa-7f774ea0d0c7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:51.479052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-97315a21-164b-4927-a8fa-7f774ea0d0c7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:51.480381 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-97315a21-164b-4927-a8fa-7f774ea0d0c7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:51.481537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-97315a21-164b-4927-a8fa-7f774ea0d0c7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:51.482215 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-97315a21-164b-4927-a8fa-7f774ea0d0c7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:51.512093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2d5ec0eb-95b5-4785-9930-0eb1800b0ede tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:51.520654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2d5ec0eb-95b5-4785-9930-0eb1800b0ede tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.227127 Jun 16 11:58:51.521573 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 188/365] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:51 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:51.528116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0849036a-1750-49ff-a6ad-4ccc0498e503 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:51.528116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0849036a-1750-49ff-a6ad-4ccc0498e503 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:51.541062 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0849036a-1750-49ff-a6ad-4ccc0498e503 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:51.541512 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0849036a-1750-49ff-a6ad-4ccc0498e503 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:51.542795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0849036a-1750-49ff-a6ad-4ccc0498e503 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:51.542795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0849036a-1750-49ff-a6ad-4ccc0498e503 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:51.627245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0849036a-1750-49ff-a6ad-4ccc0498e503 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:51.642055 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0849036a-1750-49ff-a6ad-4ccc0498e503 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1218 microversion: 2.1 time: 0.118521 Jun 16 11:58:51.643597 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 189/366] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:51 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:51.924730 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-97315a21-164b-4927-a8fa-7f774ea0d0c7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:51.934579 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-97315a21-164b-4927-a8fa-7f774ea0d0c7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1712 microversion: 2.1 time: 0.467597 Jun 16 11:58:51.935450 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 178/367] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:51 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1712 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:52.091234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-26b398a4-9c7c-42fd-a171-2522bc984ed7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:52.091839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-26b398a4-9c7c-42fd-a171-2522bc984ed7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:52.098697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-26b398a4-9c7c-42fd-a171-2522bc984ed7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.099137 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-26b398a4-9c7c-42fd-a171-2522bc984ed7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.099909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-26b398a4-9c7c-42fd-a171-2522bc984ed7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.100341 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-26b398a4-9c7c-42fd-a171-2522bc984ed7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.143960 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:52.145025 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:52.155012 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.155919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.156867 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.157296 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.188697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-26b398a4-9c7c-42fd-a171-2522bc984ed7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:52.199732 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-26b398a4-9c7c-42fd-a171-2522bc984ed7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1273 microversion: 2.1 time: 0.111723 Jun 16 11:58:52.200706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 190/368] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:52 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:52.459443 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:52.467549 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:52.469395 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:52.470600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-54f72486-a4d6-412c-85cd-afb50b02aec2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1739 microversion: 2.20 time: 0.332049 Jun 16 11:58:52.471156 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 179/369] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:52 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:52.546344 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-47f22c2c-8784-4dff-9662-4ff26a38c355 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:52.547022 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-47f22c2c-8784-4dff-9662-4ff26a38c355 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:52.553713 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-47f22c2c-8784-4dff-9662-4ff26a38c355 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.557284 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-47f22c2c-8784-4dff-9662-4ff26a38c355 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.557284 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-47f22c2c-8784-4dff-9662-4ff26a38c355 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.557284 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-47f22c2c-8784-4dff-9662-4ff26a38c355 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.659774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ae518a2f-fe02-433f-af33-2ea182156b8b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:52.660333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ae518a2f-fe02-433f-af33-2ea182156b8b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:52.666605 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae518a2f-fe02-433f-af33-2ea182156b8b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.667592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae518a2f-fe02-433f-af33-2ea182156b8b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.668369 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae518a2f-fe02-433f-af33-2ea182156b8b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.668813 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae518a2f-fe02-433f-af33-2ea182156b8b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.687951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-47f22c2c-8784-4dff-9662-4ff26a38c355 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:52.695234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-47f22c2c-8784-4dff-9662-4ff26a38c355 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1371 microversion: 2.1 time: 0.152511 Jun 16 11:58:52.696119 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 191/370] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:52 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:52.739519 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ae518a2f-fe02-433f-af33-2ea182156b8b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:52.747539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ae518a2f-fe02-433f-af33-2ea182156b8b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1266 microversion: 2.1 time: 0.091538 Jun 16 11:58:52.748132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 180/371] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:52 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:52.951829 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f382ce3c-95b4-490c-aad2-c6b74b8dd0f6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:52.952446 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f382ce3c-95b4-490c-aad2-c6b74b8dd0f6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:52.958516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f382ce3c-95b4-490c-aad2-c6b74b8dd0f6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.958961 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f382ce3c-95b4-490c-aad2-c6b74b8dd0f6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:52.959727 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f382ce3c-95b4-490c-aad2-c6b74b8dd0f6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:52.960189 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f382ce3c-95b4-490c-aad2-c6b74b8dd0f6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.096453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f382ce3c-95b4-490c-aad2-c6b74b8dd0f6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:53.106241 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f382ce3c-95b4-490c-aad2-c6b74b8dd0f6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1712 microversion: 2.1 time: 0.158672 Jun 16 11:58:53.107076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 192/372] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:52 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1712 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:53.218596 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7c028b0d-f688-42d7-ad81-eae7ac796495 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:53.219471 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7c028b0d-f688-42d7-ad81-eae7ac796495 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:53.225599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7c028b0d-f688-42d7-ad81-eae7ac796495 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.226215 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7c028b0d-f688-42d7-ad81-eae7ac796495 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.231027 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7c028b0d-f688-42d7-ad81-eae7ac796495 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.231642 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7c028b0d-f688-42d7-ad81-eae7ac796495 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.301394 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7c028b0d-f688-42d7-ad81-eae7ac796495 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:53.308982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7c028b0d-f688-42d7-ad81-eae7ac796495 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1271 microversion: 2.1 time: 0.094369 Jun 16 11:58:53.309572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 181/373] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:53 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:53.332102 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-beb41024-6bcd-4c46-af40-f3b46dd9fe64 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:53.333103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-beb41024-6bcd-4c46-af40-f3b46dd9fe64 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:53.339649 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-beb41024-6bcd-4c46-af40-f3b46dd9fe64 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.340125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-beb41024-6bcd-4c46-af40-f3b46dd9fe64 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.340917 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-beb41024-6bcd-4c46-af40-f3b46dd9fe64 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.341324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-beb41024-6bcd-4c46-af40-f3b46dd9fe64 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.488461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:53.489058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:53.494937 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.495372 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.496155 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.496583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.555629 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-beb41024-6bcd-4c46-af40-f3b46dd9fe64 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "POST /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/action" status: 202 len: 0 microversion: 2.1 time: 0.227455 Jun 16 11:58:53.556489 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 193/374] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:58:53 2022] POST /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 11:58:53.565076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a83eb304-a0b2-4d45-bac7-d909c19d1d84 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:53.565836 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a83eb304-a0b2-4d45-bac7-d909c19d1d84 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:53.572087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a83eb304-a0b2-4d45-bac7-d909c19d1d84 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.572528 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a83eb304-a0b2-4d45-bac7-d909c19d1d84 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.573781 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a83eb304-a0b2-4d45-bac7-d909c19d1d84 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.574203 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a83eb304-a0b2-4d45-bac7-d909c19d1d84 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.637982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:53.652732 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:53.654810 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:53.655651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c3125912-788c-4a48-b0a9-0587106d3b18 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1721 microversion: 2.20 time: 0.171064 Jun 16 11:58:53.657078 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 182/375] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:53 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:58:53.714404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-43e04efe-53c3-4e95-82e7-c913d0a99e0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:53.715966 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-43e04efe-53c3-4e95-82e7-c913d0a99e0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:53.722657 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-43e04efe-53c3-4e95-82e7-c913d0a99e0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.723186 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-43e04efe-53c3-4e95-82e7-c913d0a99e0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.724115 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-43e04efe-53c3-4e95-82e7-c913d0a99e0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.724624 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-43e04efe-53c3-4e95-82e7-c913d0a99e0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.756890 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a83eb304-a0b2-4d45-bac7-d909c19d1d84 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:53.765933 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a83eb304-a0b2-4d45-bac7-d909c19d1d84 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1753 microversion: 2.1 time: 0.204982 Jun 16 11:58:53.769157 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 194/376] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:53 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:53.779290 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b739666e-e549-49ba-882d-89b67042e7cb tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:53.780038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b739666e-e549-49ba-882d-89b67042e7cb tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:53.787596 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b739666e-e549-49ba-882d-89b67042e7cb tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.788103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b739666e-e549-49ba-882d-89b67042e7cb tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.788970 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b739666e-e549-49ba-882d-89b67042e7cb tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.789411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b739666e-e549-49ba-882d-89b67042e7cb tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.858860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b739666e-e549-49ba-882d-89b67042e7cb tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:53.866864 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b739666e-e549-49ba-882d-89b67042e7cb tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1266 microversion: 2.1 time: 0.096589 Jun 16 11:58:53.867365 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 195/377] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:53 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:53.880065 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-43e04efe-53c3-4e95-82e7-c913d0a99e0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:53.888519 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-43e04efe-53c3-4e95-82e7-c913d0a99e0b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1565 microversion: 2.1 time: 0.180759 Jun 16 11:58:53.889076 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 183/378] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:53 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:53.905287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b3becd3b-2602-4302-9c91-2ad62e8ea66b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:53.910651 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b3becd3b-2602-4302-9c91-2ad62e8ea66b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:53.912167 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b3becd3b-2602-4302-9c91-2ad62e8ea66b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.912613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b3becd3b-2602-4302-9c91-2ad62e8ea66b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:53.913575 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b3becd3b-2602-4302-9c91-2ad62e8ea66b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:53.914170 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b3becd3b-2602-4302-9c91-2ad62e8ea66b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.004952 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b3becd3b-2602-4302-9c91-2ad62e8ea66b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103770 Jun 16 11:58:54.005544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 196/379] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 11:58:53 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:54.125074 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e1e22e5c-1177-4258-831f-6f18e5f038e6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:54.126158 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e1e22e5c-1177-4258-831f-6f18e5f038e6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:54.132358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e1e22e5c-1177-4258-831f-6f18e5f038e6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.132890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e1e22e5c-1177-4258-831f-6f18e5f038e6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.133967 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e1e22e5c-1177-4258-831f-6f18e5f038e6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.134559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e1e22e5c-1177-4258-831f-6f18e5f038e6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.325995 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-014a189e-d7c5-4efe-8b4c-734fcf1f6c81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:54.327466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-014a189e-d7c5-4efe-8b4c-734fcf1f6c81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:54.334227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-014a189e-d7c5-4efe-8b4c-734fcf1f6c81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.334822 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-014a189e-d7c5-4efe-8b4c-734fcf1f6c81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.335733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-014a189e-d7c5-4efe-8b4c-734fcf1f6c81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.336303 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-014a189e-d7c5-4efe-8b4c-734fcf1f6c81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.493307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-014a189e-d7c5-4efe-8b4c-734fcf1f6c81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:54.502495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-014a189e-d7c5-4efe-8b4c-734fcf1f6c81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.180894 Jun 16 11:58:54.503082 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 197/380] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:54 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:54.637659 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e1e22e5c-1177-4258-831f-6f18e5f038e6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:54.647230 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e1e22e5c-1177-4258-831f-6f18e5f038e6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1716 microversion: 2.1 time: 0.525835 Jun 16 11:58:54.648333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 184/381] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:54 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1716 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:54.674544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:54.675825 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:54.682208 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.682730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.683567 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.684092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.783736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8589c0cf-0194-4905-889e-ce8082530bcc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:54.784510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8589c0cf-0194-4905-889e-ce8082530bcc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:54.793297 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8589c0cf-0194-4905-889e-ce8082530bcc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.793736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8589c0cf-0194-4905-889e-ce8082530bcc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.794902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8589c0cf-0194-4905-889e-ce8082530bcc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.795371 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8589c0cf-0194-4905-889e-ce8082530bcc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.817742 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:54.825762 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:54.827476 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:54.828822 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a0c6306f-d509-435b-a8ab-53b75efaa043 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1721 microversion: 2.20 time: 0.158199 Jun 16 11:58:54.829373 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 198/382] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:54 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:54.883915 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cb9bb350-de93-47f6-8cbd-c8d479b284c7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:54.884863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cb9bb350-de93-47f6-8cbd-c8d479b284c7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:54.891427 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb9bb350-de93-47f6-8cbd-c8d479b284c7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.892133 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb9bb350-de93-47f6-8cbd-c8d479b284c7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.892967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb9bb350-de93-47f6-8cbd-c8d479b284c7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:54.893620 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb9bb350-de93-47f6-8cbd-c8d479b284c7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:54.957032 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cb9bb350-de93-47f6-8cbd-c8d479b284c7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:54.965155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cb9bb350-de93-47f6-8cbd-c8d479b284c7 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1274 microversion: 2.1 time: 0.085156 Jun 16 11:58:54.965721 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 199/383] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:54 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:55.263792 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8589c0cf-0194-4905-889e-ce8082530bcc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:55.272841 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8589c0cf-0194-4905-889e-ce8082530bcc tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1753 microversion: 2.1 time: 0.493000 Jun 16 11:58:55.273416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 185/384] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:54 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1753 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:55.518590 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-18da512f-aff8-4005-a8b6-0ed768e79b01 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:55.519195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-18da512f-aff8-4005-a8b6-0ed768e79b01 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:55.525436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-18da512f-aff8-4005-a8b6-0ed768e79b01 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:55.526505 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-18da512f-aff8-4005-a8b6-0ed768e79b01 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:55.527285 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-18da512f-aff8-4005-a8b6-0ed768e79b01 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:55.529139 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-18da512f-aff8-4005-a8b6-0ed768e79b01 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:55.740235 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-18da512f-aff8-4005-a8b6-0ed768e79b01 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:55.749308 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-18da512f-aff8-4005-a8b6-0ed768e79b01 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.234546 Jun 16 11:58:55.749886 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 200/385] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:55 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:55.847884 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:55.848604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:55.856193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:55.856756 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:55.857939 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:55.858506 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:55.983274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-488b3dba-6f47-4d50-8b86-45ae60d0a4ab tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:55.984157 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-488b3dba-6f47-4d50-8b86-45ae60d0a4ab tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:55.990502 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-488b3dba-6f47-4d50-8b86-45ae60d0a4ab tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:55.990939 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-488b3dba-6f47-4d50-8b86-45ae60d0a4ab tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:55.991703 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-488b3dba-6f47-4d50-8b86-45ae60d0a4ab tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:55.992164 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-488b3dba-6f47-4d50-8b86-45ae60d0a4ab tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:56.055601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-488b3dba-6f47-4d50-8b86-45ae60d0a4ab tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:56.064331 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-488b3dba-6f47-4d50-8b86-45ae60d0a4ab tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1272 microversion: 2.1 time: 0.085462 Jun 16 11:58:56.064918 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 201/386] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:55 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:56.289743 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6c729232-f022-49f5-a2b5-bf84a7c2823c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:56.290343 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6c729232-f022-49f5-a2b5-bf84a7c2823c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:56.298122 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6c729232-f022-49f5-a2b5-bf84a7c2823c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:56.298559 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6c729232-f022-49f5-a2b5-bf84a7c2823c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:56.299316 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6c729232-f022-49f5-a2b5-bf84a7c2823c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:56.299750 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6c729232-f022-49f5-a2b5-bf84a7c2823c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:56.318383 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:56.458083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6c729232-f022-49f5-a2b5-bf84a7c2823c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:56.468212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6c729232-f022-49f5-a2b5-bf84a7c2823c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.182252 Jun 16 11:58:56.478926 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 202/387] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:56 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:58:56.496619 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:56.505326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:56.507101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:56.508679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6fc82efb-e7bc-4f48-8802-c9cddf22ea8c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1721 microversion: 2.20 time: 0.664858 Jun 16 11:58:56.509396 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 186/388] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:55 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1721 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:56.766866 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ea01dcde-00ea-4147-896b-9ec7a33d57cd tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:56.767601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ea01dcde-00ea-4147-896b-9ec7a33d57cd tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:56.774831 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ea01dcde-00ea-4147-896b-9ec7a33d57cd tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:56.775275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ea01dcde-00ea-4147-896b-9ec7a33d57cd tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:56.776109 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ea01dcde-00ea-4147-896b-9ec7a33d57cd tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:56.776545 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ea01dcde-00ea-4147-896b-9ec7a33d57cd tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:56.894574 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-84599e5a-8828-4fa2-99c4-750a96b8ddfb req-c5b0e8cb-bc40-45b1-8d6c-76d0cf526fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c202b5a-d86c-445a-9119-9b0893b15c1f", "tag": "f40c01cc-1a91-4c00-ac75-2e413104f6db"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:56.918265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-84599e5a-8828-4fa2-99c4-750a96b8ddfb req-c5b0e8cb-bc40-45b1-8d6c-76d0cf526fed service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:56.918707 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-84599e5a-8828-4fa2-99c4-750a96b8ddfb req-c5b0e8cb-bc40-45b1-8d6c-76d0cf526fed service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:56.921671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:56.931104 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-84599e5a-8828-4fa2-99c4-750a96b8ddfb req-c5b0e8cb-bc40-45b1-8d6c-76d0cf526fed service nova] Creating event network-changed:f40c01cc-1a91-4c00-ac75-2e413104f6db for instance 5c202b5a-d86c-445a-9119-9b0893b15c1f on hv-cinder-84614 Jun 16 11:58:56.931323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ea01dcde-00ea-4147-896b-9ec7a33d57cd tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:56.937700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-84599e5a-8828-4fa2-99c4-750a96b8ddfb req-c5b0e8cb-bc40-45b1-8d6c-76d0cf526fed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045964 Jun 16 11:58:56.938840 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 187/389] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:58:56.947736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ea01dcde-00ea-4147-896b-9ec7a33d57cd tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.182657 Jun 16 11:58:56.962064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 203/390] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:56 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:57.081950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3c5b494d-cf17-4530-96e6-424ce3bd68bc tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:57.082643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3c5b494d-cf17-4530-96e6-424ce3bd68bc tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:57.090459 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3c5b494d-cf17-4530-96e6-424ce3bd68bc tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:57.092469 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3c5b494d-cf17-4530-96e6-424ce3bd68bc tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:57.093293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3c5b494d-cf17-4530-96e6-424ce3bd68bc tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:57.093983 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3c5b494d-cf17-4530-96e6-424ce3bd68bc tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:57.180918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3c5b494d-cf17-4530-96e6-424ce3bd68bc tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:57.189485 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3c5b494d-cf17-4530-96e6-424ce3bd68bc tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1272 microversion: 2.1 time: 0.111640 Jun 16 11:58:57.190058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 188/391] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:57 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:57.490668 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f1f27556-8d2f-4326-bdb4-22120c6056e6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:57.491282 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f1f27556-8d2f-4326-bdb4-22120c6056e6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:57.505418 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1f27556-8d2f-4326-bdb4-22120c6056e6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:57.506227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1f27556-8d2f-4326-bdb4-22120c6056e6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:57.507164 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1f27556-8d2f-4326-bdb4-22120c6056e6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:57.507593 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1f27556-8d2f-4326-bdb4-22120c6056e6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:57.530239 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:57.531079 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:57.541439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:57.542451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:57.544631 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:57.545317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:57.675722 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f1f27556-8d2f-4326-bdb4-22120c6056e6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:57.686411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f1f27556-8d2f-4326-bdb4-22120c6056e6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.202288 Jun 16 11:58:57.695281 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 204/392] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:57 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:57.730705 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:57.738771 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:57.740673 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:57.741902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-28c5f93e-6434-4313-84d4-5a0a5bb142dd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1721 microversion: 2.20 time: 0.216363 Jun 16 11:58:57.742629 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 189/393] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:57 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:57.969193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0a20194a-23bb-4f95-b699-eacb29c2dc06 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:57.970022 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0a20194a-23bb-4f95-b699-eacb29c2dc06 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:57.977035 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0a20194a-23bb-4f95-b699-eacb29c2dc06 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:57.977482 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0a20194a-23bb-4f95-b699-eacb29c2dc06 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:57.978259 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0a20194a-23bb-4f95-b699-eacb29c2dc06 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:57.978690 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0a20194a-23bb-4f95-b699-eacb29c2dc06 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:58.076628 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:58.117990 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0a20194a-23bb-4f95-b699-eacb29c2dc06 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:58.125212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0a20194a-23bb-4f95-b699-eacb29c2dc06 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.160398 Jun 16 11:58:58.125772 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 205/394] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:57 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:58.206248 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9b10ebbc-49fe-4756-804c-1947db007ee6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:58.206856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9b10ebbc-49fe-4756-804c-1947db007ee6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:58.214537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b10ebbc-49fe-4756-804c-1947db007ee6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:58.214979 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b10ebbc-49fe-4756-804c-1947db007ee6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:58.215736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b10ebbc-49fe-4756-804c-1947db007ee6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:58.216190 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b10ebbc-49fe-4756-804c-1947db007ee6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:58.327950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-7587c59e-1bca-49e8-a137-84c0817b7656 req-ba9b74af-97ba-46e1-9199-684f5e95c862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6646f09a-70e9-487b-98f0-89ab1fe5508a", "name": "network-vif-unplugged", "status": "completed", "tag": "e8a94066-1a49-45d0-9264-0c1a6dbdacde"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:58.337247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-7587c59e-1bca-49e8-a137-84c0817b7656 req-ba9b74af-97ba-46e1-9199-684f5e95c862 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:58.337685 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-7587c59e-1bca-49e8-a137-84c0817b7656 req-ba9b74af-97ba-46e1-9199-684f5e95c862 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:58.348793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-7587c59e-1bca-49e8-a137-84c0817b7656 req-ba9b74af-97ba-46e1-9199-684f5e95c862 service nova] Creating event network-vif-unplugged:e8a94066-1a49-45d0-9264-0c1a6dbdacde for instance 6646f09a-70e9-487b-98f0-89ab1fe5508a on hv-cinder-84614 Jun 16 11:58:58.351361 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9b10ebbc-49fe-4756-804c-1947db007ee6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:58.354041 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-7587c59e-1bca-49e8-a137-84c0817b7656 req-ba9b74af-97ba-46e1-9199-684f5e95c862 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030124 Jun 16 11:58:58.354623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 206/395] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:58:58.361850 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9b10ebbc-49fe-4756-804c-1947db007ee6 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.159462 Jun 16 11:58:58.362421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 190/396] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:58 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:58.703106 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-01edc472-2cb7-49a7-8b2b-9c9e172e6f69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:58.703915 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-01edc472-2cb7-49a7-8b2b-9c9e172e6f69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:58.710222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-01edc472-2cb7-49a7-8b2b-9c9e172e6f69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:58.710758 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-01edc472-2cb7-49a7-8b2b-9c9e172e6f69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:58.711594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-01edc472-2cb7-49a7-8b2b-9c9e172e6f69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:58.712228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-01edc472-2cb7-49a7-8b2b-9c9e172e6f69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:58.760095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:58.760865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:58.768647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:58.769237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:58.770295 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:58.770822 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:58.897672 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-01edc472-2cb7-49a7-8b2b-9c9e172e6f69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:58.907013 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-01edc472-2cb7-49a7-8b2b-9c9e172e6f69 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.208001 Jun 16 11:58:58.907967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 207/397] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:58 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:59.092675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:59.128997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-b060f1e3-282b-4918-a9b9-0b99f53e98d3 req-e6d1df03-ae0b-4b84-b5a1-b8eded9ea920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d58de02-4dec-4af2-a327-cf3b33d46a4a", "tag": "0eda747e-b9b5-4d0c-9268-0e34cbb2bce3"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:58:59.139354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-b060f1e3-282b-4918-a9b9-0b99f53e98d3 req-e6d1df03-ae0b-4b84-b5a1-b8eded9ea920 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:59.139904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-b060f1e3-282b-4918-a9b9-0b99f53e98d3 req-e6d1df03-ae0b-4b84-b5a1-b8eded9ea920 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:59.151396 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-b060f1e3-282b-4918-a9b9-0b99f53e98d3 req-e6d1df03-ae0b-4b84-b5a1-b8eded9ea920 service nova] Creating event network-changed:0eda747e-b9b5-4d0c-9268-0e34cbb2bce3 for instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a on hv-cinder-84614 Jun 16 11:58:59.156286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-b060f1e3-282b-4918-a9b9-0b99f53e98d3 req-e6d1df03-ae0b-4b84-b5a1-b8eded9ea920 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031024 Jun 16 11:58:59.160813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 208/398] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:58:59.161973 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ad85f1aa-130e-46fe-ba5b-6881f9394c78 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:59.162658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ad85f1aa-130e-46fe-ba5b-6881f9394c78 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:59.168952 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad85f1aa-130e-46fe-ba5b-6881f9394c78 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:59.169476 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad85f1aa-130e-46fe-ba5b-6881f9394c78 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:59.170287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad85f1aa-130e-46fe-ba5b-6881f9394c78 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:59.170718 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad85f1aa-130e-46fe-ba5b-6881f9394c78 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:59.322516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ad85f1aa-130e-46fe-ba5b-6881f9394c78 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:59.329127 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:59.340046 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ad85f1aa-130e-46fe-ba5b-6881f9394c78 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.181608 Jun 16 11:58:59.340996 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 209/399] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:59 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:59.342405 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:59.344843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:59.346068 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5bd6117f-b015-4f8f-9166-8edc13df8d80 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1721 microversion: 2.20 time: 0.589901 Jun 16 11:58:59.352546 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 191/400] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:58:58 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1721 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:58:59.379023 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fad29e9e-0166-4e87-ac88-643fb7401343 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:59.379633 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-fad29e9e-0166-4e87-ac88-643fb7401343 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:59.386344 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fad29e9e-0166-4e87-ac88-643fb7401343 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:59.386791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fad29e9e-0166-4e87-ac88-643fb7401343 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:59.387561 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fad29e9e-0166-4e87-ac88-643fb7401343 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:59.388024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fad29e9e-0166-4e87-ac88-643fb7401343 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:59.563504 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-fad29e9e-0166-4e87-ac88-643fb7401343 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:58:59.575564 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-fad29e9e-0166-4e87-ac88-643fb7401343 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.200507 Jun 16 11:58:59.576250 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 210/401] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:59 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:58:59.924633 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8d96dc37-eb03-4485-83e0-3705d413843f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:58:59.925546 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8d96dc37-eb03-4485-83e0-3705d413843f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:58:59.928809 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=8 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:59.932687 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8d96dc37-eb03-4485-83e0-3705d413843f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:59.933165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8d96dc37-eb03-4485-83e0-3705d413843f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:58:59.934000 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8d96dc37-eb03-4485-83e0-3705d413843f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:58:59.934521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8d96dc37-eb03-4485-83e0-3705d413843f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.132531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8d96dc37-eb03-4485-83e0-3705d413843f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:00.142387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8d96dc37-eb03-4485-83e0-3705d413843f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.221562 Jun 16 11:59:00.142968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 192/402] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:58:59 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:00.356875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fc8a9519-f561-486d-be9c-9d5f8f22bc95 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:00.357650 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-fc8a9519-f561-486d-be9c-9d5f8f22bc95 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:00.360206 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:00.364146 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:00.364896 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:00.367214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fc8a9519-f561-486d-be9c-9d5f8f22bc95 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:00.367660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fc8a9519-f561-486d-be9c-9d5f8f22bc95 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.368464 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fc8a9519-f561-486d-be9c-9d5f8f22bc95 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:00.368895 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fc8a9519-f561-486d-be9c-9d5f8f22bc95 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.372465 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:00.373083 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.373923 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:00.374421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.495850 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=16 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:00.503738 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-fc8a9519-f561-486d-be9c-9d5f8f22bc95 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:00.515187 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-fc8a9519-f561-486d-be9c-9d5f8f22bc95 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.162283 Jun 16 11:59:00.516404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:00.517051 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 211/403] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:00 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:00.525377 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:00.527053 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:00.528571 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-44986831-323c-4602-af35-109a917a1be0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1664 microversion: 2.20 time: 0.168399 Jun 16 11:59:00.529340 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 193/404] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:00 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:59:00.550437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e2c923f3-1db9-4828-b1b8-6d99ef2a0abc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db98670e-4fdc-4ca0-8f81-90fa94b2388e"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:00.551539 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e2c923f3-1db9-4828-b1b8-6d99ef2a0abc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:00.557854 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e2c923f3-1db9-4828-b1b8-6d99ef2a0abc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:00.558287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e2c923f3-1db9-4828-b1b8-6d99ef2a0abc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.559045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e2c923f3-1db9-4828-b1b8-6d99ef2a0abc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:00.559468 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e2c923f3-1db9-4828-b1b8-6d99ef2a0abc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.592185 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-281345eb-1b48-49c5-994a-087d6dbb4d78 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:00.592803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-281345eb-1b48-49c5-994a-087d6dbb4d78 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:00.599298 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-281345eb-1b48-49c5-994a-087d6dbb4d78 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:00.599743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-281345eb-1b48-49c5-994a-087d6dbb4d78 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.600541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-281345eb-1b48-49c5-994a-087d6dbb4d78 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:00.600996 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-281345eb-1b48-49c5-994a-087d6dbb4d78 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:00.735902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-281345eb-1b48-49c5-994a-087d6dbb4d78 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:00.746113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-281345eb-1b48-49c5-994a-087d6dbb4d78 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.157644 Jun 16 11:59:00.747786 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 194/405] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:00 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:01.160195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a527c5bc-9a81-4d61-abef-d987ad663abb tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:01.160811 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a527c5bc-9a81-4d61-abef-d987ad663abb tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:01.167276 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a527c5bc-9a81-4d61-abef-d987ad663abb tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.167723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a527c5bc-9a81-4d61-abef-d987ad663abb tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.168518 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a527c5bc-9a81-4d61-abef-d987ad663abb tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.168946 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a527c5bc-9a81-4d61-abef-d987ad663abb tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.513482 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a527c5bc-9a81-4d61-abef-d987ad663abb tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:01.526655 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a527c5bc-9a81-4d61-abef-d987ad663abb tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.370331 Jun 16 11:59:01.529510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 195/406] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:01 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:01.535310 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-9ff0fda5-a61b-4440-81e0-411dd7557dff req-188cbd11-f35e-4363-8a91-d20d82901b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc6b840-6f8e-4073-9ddd-9fe71329c594", "tag": "b6c3db1b-87a4-4647-b2ae-1f5fdffcc556"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:01.544184 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-9ff0fda5-a61b-4440-81e0-411dd7557dff req-188cbd11-f35e-4363-8a91-d20d82901b8c service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.547856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-9ff0fda5-a61b-4440-81e0-411dd7557dff req-188cbd11-f35e-4363-8a91-d20d82901b8c service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.556802 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-9ff0fda5-a61b-4440-81e0-411dd7557dff req-188cbd11-f35e-4363-8a91-d20d82901b8c service nova] Creating event network-changed:b6c3db1b-87a4-4647-b2ae-1f5fdffcc556 for instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 on hv-cinder-84614 Jun 16 11:59:01.562387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-9ff0fda5-a61b-4440-81e0-411dd7557dff req-188cbd11-f35e-4363-8a91-d20d82901b8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031561 Jun 16 11:59:01.563116 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 196/407] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:59:01.568801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a78a71e9-8a37-48d5-98bc-b28a8b27d8d7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:01.569559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a78a71e9-8a37-48d5-98bc-b28a8b27d8d7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:01.576480 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a78a71e9-8a37-48d5-98bc-b28a8b27d8d7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.576992 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a78a71e9-8a37-48d5-98bc-b28a8b27d8d7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.577917 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a78a71e9-8a37-48d5-98bc-b28a8b27d8d7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.578484 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a78a71e9-8a37-48d5-98bc-b28a8b27d8d7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.648653 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e2c923f3-1db9-4828-b1b8-6d99ef2a0abc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.102431 Jun 16 11:59:01.649890 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 212/408] 10.222.0.40 () {62 vars in 1363 bytes} [Thu Jun 16 11:59:00 2022] POST /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments => generated 188 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 11:59:01.763200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-54c4b5d9-5be3-4cd3-8b0f-40b05dcb99d9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:01.763835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-54c4b5d9-5be3-4cd3-8b0f-40b05dcb99d9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:01.771569 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54c4b5d9-5be3-4cd3-8b0f-40b05dcb99d9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.772068 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54c4b5d9-5be3-4cd3-8b0f-40b05dcb99d9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.772892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54c4b5d9-5be3-4cd3-8b0f-40b05dcb99d9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.773328 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54c4b5d9-5be3-4cd3-8b0f-40b05dcb99d9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.776560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a78a71e9-8a37-48d5-98bc-b28a8b27d8d7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:01.784335 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a78a71e9-8a37-48d5-98bc-b28a8b27d8d7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.219788 Jun 16 11:59:01.785174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 197/409] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:01 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:01.789991 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7001bf16-c4ad-4099-b96e-e50eeca61b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:01.790719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7001bf16-c4ad-4099-b96e-e50eeca61b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:01.796731 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7001bf16-c4ad-4099-b96e-e50eeca61b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.797168 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7001bf16-c4ad-4099-b96e-e50eeca61b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.797913 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7001bf16-c4ad-4099-b96e-e50eeca61b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:01.798333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7001bf16-c4ad-4099-b96e-e50eeca61b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:01.930913 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-54c4b5d9-5be3-4cd3-8b0f-40b05dcb99d9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:01.939172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-54c4b5d9-5be3-4cd3-8b0f-40b05dcb99d9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.180597 Jun 16 11:59:01.939837 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 213/410] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:01 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:01.993865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7001bf16-c4ad-4099-b96e-e50eeca61b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/action" status: 202 len: 0 microversion: 2.20 time: 0.207577 Jun 16 11:59:01.995130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 198/411] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jun 16 11:59:01 2022] POST /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 11:59:02.003501 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:02.004256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:02.011035 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:02.011488 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:02.012290 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:02.012700 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:02.146144 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:02.154812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:02.156363 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:02.157529 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3dc9f945-ad27-4ca2-84de-02ff4ffcdd2b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1750 microversion: 2.20 time: 0.157882 Jun 16 11:59:02.158091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 214/412] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:01 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:02.543801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-782db8d6-15c6-4e04-8988-277d28aa3408 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:02.544507 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-782db8d6-15c6-4e04-8988-277d28aa3408 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:02.550507 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-782db8d6-15c6-4e04-8988-277d28aa3408 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:02.550949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-782db8d6-15c6-4e04-8988-277d28aa3408 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:02.551702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-782db8d6-15c6-4e04-8988-277d28aa3408 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:02.552173 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-782db8d6-15c6-4e04-8988-277d28aa3408 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:02.729776 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-782db8d6-15c6-4e04-8988-277d28aa3408 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:02.737895 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-782db8d6-15c6-4e04-8988-277d28aa3408 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.198573 Jun 16 11:59:02.738602 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 199/413] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:02 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:02.802014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5e4eef0a-8663-405d-b6d9-a8d6bd8b5e9e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:02.803155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5e4eef0a-8663-405d-b6d9-a8d6bd8b5e9e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:02.810903 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5e4eef0a-8663-405d-b6d9-a8d6bd8b5e9e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:02.811351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5e4eef0a-8663-405d-b6d9-a8d6bd8b5e9e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:02.812456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5e4eef0a-8663-405d-b6d9-a8d6bd8b5e9e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:02.813157 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5e4eef0a-8663-405d-b6d9-a8d6bd8b5e9e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:02.956716 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f3bcbfb1-a279-423d-aa3a-6c97aa091853 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:02.958091 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f3bcbfb1-a279-423d-aa3a-6c97aa091853 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:02.970773 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f3bcbfb1-a279-423d-aa3a-6c97aa091853 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:02.971765 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f3bcbfb1-a279-423d-aa3a-6c97aa091853 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:02.972998 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f3bcbfb1-a279-423d-aa3a-6c97aa091853 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:02.973441 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f3bcbfb1-a279-423d-aa3a-6c97aa091853 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:03.031049 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5e4eef0a-8663-405d-b6d9-a8d6bd8b5e9e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:03.038853 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5e4eef0a-8663-405d-b6d9-a8d6bd8b5e9e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.240941 Jun 16 11:59:03.040579 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 215/414] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:02 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:03.176350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:03.176979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:03.185118 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:03.187252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:03.188457 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:03.190468 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:03.212473 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f3bcbfb1-a279-423d-aa3a-6c97aa091853 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:03.220336 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f3bcbfb1-a279-423d-aa3a-6c97aa091853 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.267998 Jun 16 11:59:03.220905 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 200/415] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:02 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:03.338732 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:03.348158 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:03.350263 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:03.352164 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-28d98fb9-2548-4c58-a09e-337461ab927e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1750 microversion: 2.20 time: 0.179225 Jun 16 11:59:03.353538 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 216/416] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:03 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:03.756135 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d6a58013-ec4f-4b7f-a1e6-fe9f50e5af14 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:03.756964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d6a58013-ec4f-4b7f-a1e6-fe9f50e5af14 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:03.765607 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d6a58013-ec4f-4b7f-a1e6-fe9f50e5af14 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:03.766051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d6a58013-ec4f-4b7f-a1e6-fe9f50e5af14 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:03.773697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d6a58013-ec4f-4b7f-a1e6-fe9f50e5af14 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:03.773697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d6a58013-ec4f-4b7f-a1e6-fe9f50e5af14 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:03.926782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d6a58013-ec4f-4b7f-a1e6-fe9f50e5af14 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:03.934931 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d6a58013-ec4f-4b7f-a1e6-fe9f50e5af14 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.183150 Jun 16 11:59:03.944841 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 201/417] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:03 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:04.055550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-81f8a8e3-6831-4d58-93d0-b2055a036bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:04.056180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-81f8a8e3-6831-4d58-93d0-b2055a036bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:04.063116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81f8a8e3-6831-4d58-93d0-b2055a036bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:04.063553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81f8a8e3-6831-4d58-93d0-b2055a036bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:04.064368 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81f8a8e3-6831-4d58-93d0-b2055a036bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:04.064795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81f8a8e3-6831-4d58-93d0-b2055a036bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:04.193967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-81f8a8e3-6831-4d58-93d0-b2055a036bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:04.197483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:04.207215 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-81f8a8e3-6831-4d58-93d0-b2055a036bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.155286 Jun 16 11:59:04.217555 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 217/418] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:04 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:04.239585 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a7268092-405d-4dff-850b-085ea9e7a639 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:04.241277 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a7268092-405d-4dff-850b-085ea9e7a639 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:04.258242 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a7268092-405d-4dff-850b-085ea9e7a639 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:04.258698 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a7268092-405d-4dff-850b-085ea9e7a639 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:04.260137 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a7268092-405d-4dff-850b-085ea9e7a639 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:04.260573 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a7268092-405d-4dff-850b-085ea9e7a639 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:04.372627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:04.373255 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:04.380397 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:04.380753 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:04.381527 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:04.381951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:04.555506 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:04.566066 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:04.573001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:04.573001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5391c771-1edc-43a8-8b79-7f0f1222e276 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1752 microversion: 2.20 time: 0.200433 Jun 16 11:59:04.573001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 218/419] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:04 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:04.811423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a7268092-405d-4dff-850b-085ea9e7a639 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:04.833792 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a7268092-405d-4dff-850b-085ea9e7a639 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.598547 Jun 16 11:59:04.840219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 202/420] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:04 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:04.958342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bb230160-73a3-4cc7-ba29-9bb0face8333 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:04.958342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bb230160-73a3-4cc7-ba29-9bb0face8333 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:04.962228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb230160-73a3-4cc7-ba29-9bb0face8333 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:04.962797 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb230160-73a3-4cc7-ba29-9bb0face8333 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:04.964287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb230160-73a3-4cc7-ba29-9bb0face8333 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:04.964812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bb230160-73a3-4cc7-ba29-9bb0face8333 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:05.163935 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bb230160-73a3-4cc7-ba29-9bb0face8333 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:05.173095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bb230160-73a3-4cc7-ba29-9bb0face8333 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.223765 Jun 16 11:59:05.173829 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 219/421] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:04 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:05.226033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-388ae314-8adc-4e78-93fa-4ddad100c8c3 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:05.226655 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-388ae314-8adc-4e78-93fa-4ddad100c8c3 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:05.232917 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-388ae314-8adc-4e78-93fa-4ddad100c8c3 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:05.233575 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-388ae314-8adc-4e78-93fa-4ddad100c8c3 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:05.234369 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-388ae314-8adc-4e78-93fa-4ddad100c8c3 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:05.235256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-388ae314-8adc-4e78-93fa-4ddad100c8c3 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:05.387446 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-388ae314-8adc-4e78-93fa-4ddad100c8c3 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:05.395829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-388ae314-8adc-4e78-93fa-4ddad100c8c3 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.173975 Jun 16 11:59:05.395829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 203/422] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:05 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:05.588468 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:05.589298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:05.596353 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:05.596790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:05.597550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:05.597977 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:05.738226 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:05.747827 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:05.749348 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:05.750560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e7664845-5f19-4ce4-bb2b-5da1492a121e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.166851 Jun 16 11:59:05.751119 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 220/423] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:05 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:59:05.859184 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-142cba76-26d0-4daf-9d3a-9cf465208418 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:05.859822 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-142cba76-26d0-4daf-9d3a-9cf465208418 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:05.866325 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-142cba76-26d0-4daf-9d3a-9cf465208418 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:05.866773 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-142cba76-26d0-4daf-9d3a-9cf465208418 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:05.867531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-142cba76-26d0-4daf-9d3a-9cf465208418 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:05.867991 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-142cba76-26d0-4daf-9d3a-9cf465208418 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:05.872042 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:06.102192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-142cba76-26d0-4daf-9d3a-9cf465208418 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:06.111936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-142cba76-26d0-4daf-9d3a-9cf465208418 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.256267 Jun 16 11:59:06.112626 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 204/424] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:05 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:06.190599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0f389dfa-44c7-4429-a8d7-cbe3b31a95a4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:06.191205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0f389dfa-44c7-4429-a8d7-cbe3b31a95a4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:06.198296 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f389dfa-44c7-4429-a8d7-cbe3b31a95a4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:06.198745 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f389dfa-44c7-4429-a8d7-cbe3b31a95a4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:06.199515 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f389dfa-44c7-4429-a8d7-cbe3b31a95a4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:06.199974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f389dfa-44c7-4429-a8d7-cbe3b31a95a4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:06.352251 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0f389dfa-44c7-4429-a8d7-cbe3b31a95a4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:06.360505 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0f389dfa-44c7-4429-a8d7-cbe3b31a95a4 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.173717 Jun 16 11:59:06.361066 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 221/425] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:06 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:06.411305 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5f4ca955-0255-4116-9071-f0a28fba6bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:06.411936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5f4ca955-0255-4116-9071-f0a28fba6bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:06.418476 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f4ca955-0255-4116-9071-f0a28fba6bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:06.418962 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f4ca955-0255-4116-9071-f0a28fba6bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:06.419653 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f4ca955-0255-4116-9071-f0a28fba6bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:06.420108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f4ca955-0255-4116-9071-f0a28fba6bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:06.580570 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5f4ca955-0255-4116-9071-f0a28fba6bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:06.588065 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5f4ca955-0255-4116-9071-f0a28fba6bfc tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.180452 Jun 16 11:59:06.588656 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 205/426] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:06 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:06.769091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:06.769793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:06.775984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:06.776434 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:06.777195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:06.777748 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:06.908193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:06.917320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:06.918896 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:06.920081 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-46ced7de-2a25-419d-ae6d-9c3db9b70faa tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.155178 Jun 16 11:59:06.920641 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 222/427] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:06 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:07.127956 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-241f8b36-91f8-4e03-b171-32243aaa0d14 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:07.128675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-241f8b36-91f8-4e03-b171-32243aaa0d14 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:07.131041 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:07.136017 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-241f8b36-91f8-4e03-b171-32243aaa0d14 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.136531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-241f8b36-91f8-4e03-b171-32243aaa0d14 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:07.137357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-241f8b36-91f8-4e03-b171-32243aaa0d14 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.137854 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-241f8b36-91f8-4e03-b171-32243aaa0d14 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:07.276571 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-241f8b36-91f8-4e03-b171-32243aaa0d14 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:07.284018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-241f8b36-91f8-4e03-b171-32243aaa0d14 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.159879 Jun 16 11:59:07.284588 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 206/428] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:07 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:07.377783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-16222870-198e-4197-95a0-de8059974bbf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:07.379190 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-16222870-198e-4197-95a0-de8059974bbf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:07.386124 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-16222870-198e-4197-95a0-de8059974bbf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.391495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-16222870-198e-4197-95a0-de8059974bbf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:07.391495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-16222870-198e-4197-95a0-de8059974bbf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.391495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-16222870-198e-4197-95a0-de8059974bbf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:07.417208 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-c133ac25-1687-49be-8564-9f390577a0a4 req-ee861a0b-d60a-4b34-8f17-960bb61bf754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc6b840-6f8e-4073-9ddd-9fe71329c594", "name": "network-vif-plugged", "status": "completed", "tag": "b6c3db1b-87a4-4647-b2ae-1f5fdffcc556"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:07.430075 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-c133ac25-1687-49be-8564-9f390577a0a4 req-ee861a0b-d60a-4b34-8f17-960bb61bf754 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.440382 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-c133ac25-1687-49be-8564-9f390577a0a4 req-ee861a0b-d60a-4b34-8f17-960bb61bf754 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:07.455110 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-c133ac25-1687-49be-8564-9f390577a0a4 req-ee861a0b-d60a-4b34-8f17-960bb61bf754 service nova] Creating event network-vif-plugged:b6c3db1b-87a4-4647-b2ae-1f5fdffcc556 for instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 on hv-cinder-84614 Jun 16 11:59:07.460240 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-c133ac25-1687-49be-8564-9f390577a0a4 req-ee861a0b-d60a-4b34-8f17-960bb61bf754 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047619 Jun 16 11:59:07.461121 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 207/429] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:59:07.580029 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-16222870-198e-4197-95a0-de8059974bbf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:07.592261 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-16222870-198e-4197-95a0-de8059974bbf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.218780 Jun 16 11:59:07.609297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 223/430] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:07 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:07.609612 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f9b8e9ca-031e-4590-a62a-bc6ff5f8cd23 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:07.609612 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f9b8e9ca-031e-4590-a62a-bc6ff5f8cd23 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:07.614518 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f9b8e9ca-031e-4590-a62a-bc6ff5f8cd23 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.615097 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f9b8e9ca-031e-4590-a62a-bc6ff5f8cd23 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:07.616365 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f9b8e9ca-031e-4590-a62a-bc6ff5f8cd23 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.617040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f9b8e9ca-031e-4590-a62a-bc6ff5f8cd23 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:07.802086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f9b8e9ca-031e-4590-a62a-bc6ff5f8cd23 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:07.811344 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f9b8e9ca-031e-4590-a62a-bc6ff5f8cd23 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.209791 Jun 16 11:59:07.812334 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 208/431] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:07 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:07.939095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:07.940032 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:07.948351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.948799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:07.949574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:07.950007 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:08.134401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:08.151402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:08.157374 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:08.157374 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-16bd6bf5-9130-4d8f-bdcc-f1ae6b90f079 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.220663 Jun 16 11:59:08.157374 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 224/432] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:07 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:08.301485 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e4d685bb-8c49-4d01-ab1e-578e0eff3660 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:08.302080 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e4d685bb-8c49-4d01-ab1e-578e0eff3660 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:08.309831 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4d685bb-8c49-4d01-ab1e-578e0eff3660 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:08.310505 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4d685bb-8c49-4d01-ab1e-578e0eff3660 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:08.311428 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4d685bb-8c49-4d01-ab1e-578e0eff3660 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:08.312073 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4d685bb-8c49-4d01-ab1e-578e0eff3660 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:08.458620 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e4d685bb-8c49-4d01-ab1e-578e0eff3660 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:08.466931 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e4d685bb-8c49-4d01-ab1e-578e0eff3660 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.169034 Jun 16 11:59:08.476943 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 209/433] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:08 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:08.616594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-15765c1a-9496-40ac-9681-8cf4235a14cd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:08.617259 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-15765c1a-9496-40ac-9681-8cf4235a14cd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:08.624398 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15765c1a-9496-40ac-9681-8cf4235a14cd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:08.624836 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15765c1a-9496-40ac-9681-8cf4235a14cd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:08.625775 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15765c1a-9496-40ac-9681-8cf4235a14cd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:08.626052 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15765c1a-9496-40ac-9681-8cf4235a14cd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:08.794973 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-15765c1a-9496-40ac-9681-8cf4235a14cd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:08.803463 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-15765c1a-9496-40ac-9681-8cf4235a14cd tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.190798 Jun 16 11:59:08.804054 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 225/434] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:08 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:08.834928 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3a9b01ab-92e1-432d-8d4d-3ac538f9daaf tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:08.835547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3a9b01ab-92e1-432d-8d4d-3ac538f9daaf tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:08.852871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3a9b01ab-92e1-432d-8d4d-3ac538f9daaf tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:08.853321 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3a9b01ab-92e1-432d-8d4d-3ac538f9daaf tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:08.854633 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3a9b01ab-92e1-432d-8d4d-3ac538f9daaf tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:08.860537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3a9b01ab-92e1-432d-8d4d-3ac538f9daaf tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:08.998081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3a9b01ab-92e1-432d-8d4d-3ac538f9daaf tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:09.006657 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3a9b01ab-92e1-432d-8d4d-3ac538f9daaf tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.181729 Jun 16 11:59:09.008006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 210/435] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:08 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:09.175447 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:09.176099 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:09.182661 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:09.183103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:09.183885 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:09.184317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:09.363532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:09.376087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:09.377787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:09.379044 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-63db8901-a2d0-4967-a4bb-1c2c4e168056 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.207665 Jun 16 11:59:09.379696 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 226/436] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:09 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:09.477541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-e50ad09d-5079-4b1c-b838-72449718df68 req-abba40f7-e502-475a-aa5d-0b171df81036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d58de02-4dec-4af2-a327-cf3b33d46a4a", "name": "network-vif-plugged", "status": "completed", "tag": "0eda747e-b9b5-4d0c-9268-0e34cbb2bce3"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:09.484321 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-87598d2c-1f62-4bb2-8ac3-9c7da4e33e31 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:09.484931 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-87598d2c-1f62-4bb2-8ac3-9c7da4e33e31 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:09.487212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-e50ad09d-5079-4b1c-b838-72449718df68 req-abba40f7-e502-475a-aa5d-0b171df81036 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:09.487703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-e50ad09d-5079-4b1c-b838-72449718df68 req-abba40f7-e502-475a-aa5d-0b171df81036 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:09.494815 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-87598d2c-1f62-4bb2-8ac3-9c7da4e33e31 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:09.495286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-87598d2c-1f62-4bb2-8ac3-9c7da4e33e31 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:09.496160 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-87598d2c-1f62-4bb2-8ac3-9c7da4e33e31 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:09.496621 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-87598d2c-1f62-4bb2-8ac3-9c7da4e33e31 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:09.500203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-e50ad09d-5079-4b1c-b838-72449718df68 req-abba40f7-e502-475a-aa5d-0b171df81036 service nova] Creating event network-vif-plugged:0eda747e-b9b5-4d0c-9268-0e34cbb2bce3 for instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a on hv-cinder-84614 Jun 16 11:59:09.505578 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-e50ad09d-5079-4b1c-b838-72449718df68 req-abba40f7-e502-475a-aa5d-0b171df81036 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031739 Jun 16 11:59:09.506211 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 211/437] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:59:09.669013 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-87598d2c-1f62-4bb2-8ac3-9c7da4e33e31 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:09.677123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-87598d2c-1f62-4bb2-8ac3-9c7da4e33e31 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.196489 Jun 16 11:59:09.686871 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 227/438] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:09 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:09.838051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b474a267-9e07-4d8f-8cbd-c9787871b1ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:09.838051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b474a267-9e07-4d8f-8cbd-c9787871b1ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:09.838051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b474a267-9e07-4d8f-8cbd-c9787871b1ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:09.838051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b474a267-9e07-4d8f-8cbd-c9787871b1ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:09.838641 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b474a267-9e07-4d8f-8cbd-c9787871b1ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:09.838641 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b474a267-9e07-4d8f-8cbd-c9787871b1ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:09.990139 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b474a267-9e07-4d8f-8cbd-c9787871b1ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:10.012272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b474a267-9e07-4d8f-8cbd-c9787871b1ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.194804 Jun 16 11:59:10.012863 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 212/439] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:09 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:10.025113 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8cbfee3b-cf98-4454-aff4-3712c836476f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:10.025966 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8cbfee3b-cf98-4454-aff4-3712c836476f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:10.032987 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8cbfee3b-cf98-4454-aff4-3712c836476f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:10.033428 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8cbfee3b-cf98-4454-aff4-3712c836476f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:10.034747 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8cbfee3b-cf98-4454-aff4-3712c836476f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:10.035646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8cbfee3b-cf98-4454-aff4-3712c836476f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:10.206026 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8cbfee3b-cf98-4454-aff4-3712c836476f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:10.214282 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8cbfee3b-cf98-4454-aff4-3712c836476f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.193332 Jun 16 11:59:10.220459 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 228/440] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:10 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:10.396977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:10.397587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:10.404458 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:10.404976 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:10.405747 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:10.406186 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:10.552922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:10.562117 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:10.563636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:10.564823 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4e931924-9c83-48d8-94e3-b342189d8a62 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.171731 Jun 16 11:59:10.565411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 213/441] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:10 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:10.695067 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3b714871-9ad9-40da-b17f-22c4338e3360 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:10.696097 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3b714871-9ad9-40da-b17f-22c4338e3360 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:10.702636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b714871-9ad9-40da-b17f-22c4338e3360 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:10.704520 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b714871-9ad9-40da-b17f-22c4338e3360 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:10.704520 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b714871-9ad9-40da-b17f-22c4338e3360 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:10.704520 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3b714871-9ad9-40da-b17f-22c4338e3360 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:10.856441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3b714871-9ad9-40da-b17f-22c4338e3360 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:10.864195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3b714871-9ad9-40da-b17f-22c4338e3360 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.173402 Jun 16 11:59:10.864758 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 229/442] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:10 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:11.029828 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ab5bbbb1-e84a-4cb4-b25a-26d31a945ca7 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:11.030741 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ab5bbbb1-e84a-4cb4-b25a-26d31a945ca7 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:11.037126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbb1-e84a-4cb4-b25a-26d31a945ca7 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:11.037760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbb1-e84a-4cb4-b25a-26d31a945ca7 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:11.038549 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbb1-e84a-4cb4-b25a-26d31a945ca7 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:11.039146 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbb1-e84a-4cb4-b25a-26d31a945ca7 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:11.190666 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ab5bbbb1-e84a-4cb4-b25a-26d31a945ca7 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:11.199405 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ab5bbbb1-e84a-4cb4-b25a-26d31a945ca7 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.173846 Jun 16 11:59:11.201739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 214/443] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:11 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:11.236813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5d88daf6-973f-4d2f-b176-9d409f540a3f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:11.237714 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5d88daf6-973f-4d2f-b176-9d409f540a3f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:11.246707 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5d88daf6-973f-4d2f-b176-9d409f540a3f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:11.248701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5d88daf6-973f-4d2f-b176-9d409f540a3f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:11.248701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5d88daf6-973f-4d2f-b176-9d409f540a3f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:11.248701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5d88daf6-973f-4d2f-b176-9d409f540a3f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:11.396289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5d88daf6-973f-4d2f-b176-9d409f540a3f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:11.404889 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5d88daf6-973f-4d2f-b176-9d409f540a3f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.176801 Jun 16 11:59:11.405543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 230/444] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:11 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:11.585241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:11.585847 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:11.594101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:11.598898 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:11.599888 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:11.600603 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:11.804052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:11.804052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:11.804338 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:11.804338 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-16872702-eb79-4f8f-a116-8121ac11c68a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.186284 Jun 16 11:59:11.804338 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 215/445] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:11 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:11.886912 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e7d110c4-9545-4088-baa5-6b631423627b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:11.887701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e7d110c4-9545-4088-baa5-6b631423627b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:11.894432 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7d110c4-9545-4088-baa5-6b631423627b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:11.894879 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7d110c4-9545-4088-baa5-6b631423627b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:11.895647 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7d110c4-9545-4088-baa5-6b631423627b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:11.896111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e7d110c4-9545-4088-baa5-6b631423627b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:12.045365 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e7d110c4-9545-4088-baa5-6b631423627b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:12.055303 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e7d110c4-9545-4088-baa5-6b631423627b tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.177547 Jun 16 11:59:12.055812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 231/446] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:11 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:12.216055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4ddb882c-2960-4bf3-a4ce-855012c0a6a6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:12.217097 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4ddb882c-2960-4bf3-a4ce-855012c0a6a6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:12.223908 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4ddb882c-2960-4bf3-a4ce-855012c0a6a6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:12.224794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4ddb882c-2960-4bf3-a4ce-855012c0a6a6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:12.226324 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4ddb882c-2960-4bf3-a4ce-855012c0a6a6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:12.226859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4ddb882c-2960-4bf3-a4ce-855012c0a6a6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:12.401603 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4ddb882c-2960-4bf3-a4ce-855012c0a6a6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:12.409958 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4ddb882c-2960-4bf3-a4ce-855012c0a6a6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.197803 Jun 16 11:59:12.410581 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 216/447] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:12 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:12.422717 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-dbc698ae-2564-4250-a3bf-13510d4a79b8 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:12.423522 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-dbc698ae-2564-4250-a3bf-13510d4a79b8 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:12.431332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dbc698ae-2564-4250-a3bf-13510d4a79b8 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:12.432513 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dbc698ae-2564-4250-a3bf-13510d4a79b8 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:12.433386 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dbc698ae-2564-4250-a3bf-13510d4a79b8 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:12.433982 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dbc698ae-2564-4250-a3bf-13510d4a79b8 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:12.581881 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-dbc698ae-2564-4250-a3bf-13510d4a79b8 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:12.591668 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-dbc698ae-2564-4250-a3bf-13510d4a79b8 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.172678 Jun 16 11:59:12.592571 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 232/448] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:12 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:12.811642 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:12.812379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:12.819246 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:12.819698 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:12.820497 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:12.821075 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:12.979940 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:12.988605 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:12.990232 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:12.991395 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c632f8f1-85c3-458a-a201-21a502b82c8a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.183834 Jun 16 11:59:12.992153 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 217/449] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:12 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:13.074315 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-845448e5-920d-4824-8542-3a518f015ee9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:13.075028 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-845448e5-920d-4824-8542-3a518f015ee9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:13.081639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-845448e5-920d-4824-8542-3a518f015ee9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:13.082172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-845448e5-920d-4824-8542-3a518f015ee9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:13.083048 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-845448e5-920d-4824-8542-3a518f015ee9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:13.083548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-845448e5-920d-4824-8542-3a518f015ee9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:13.229681 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-845448e5-920d-4824-8542-3a518f015ee9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:13.237298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-845448e5-920d-4824-8542-3a518f015ee9 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.167697 Jun 16 11:59:13.237875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 233/450] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:13 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:13.428015 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-52d18495-a0ee-483a-9940-2903f913ab4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:13.428549 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-52d18495-a0ee-483a-9940-2903f913ab4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:13.435156 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-52d18495-a0ee-483a-9940-2903f913ab4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:13.435590 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-52d18495-a0ee-483a-9940-2903f913ab4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:13.436364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-52d18495-a0ee-483a-9940-2903f913ab4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:13.436788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-52d18495-a0ee-483a-9940-2903f913ab4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:13.595683 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-52d18495-a0ee-483a-9940-2903f913ab4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:13.604867 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-52d18495-a0ee-483a-9940-2903f913ab4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.180808 Jun 16 11:59:13.605754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 218/451] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:13 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:13.610045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-027e51c6-8e95-43ab-8914-e0dcd3f79d81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:13.612846 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-027e51c6-8e95-43ab-8914-e0dcd3f79d81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:13.620944 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-027e51c6-8e95-43ab-8914-e0dcd3f79d81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:13.621397 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-027e51c6-8e95-43ab-8914-e0dcd3f79d81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:13.622181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-027e51c6-8e95-43ab-8914-e0dcd3f79d81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:13.622661 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-027e51c6-8e95-43ab-8914-e0dcd3f79d81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:13.647165 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:13.781821 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-027e51c6-8e95-43ab-8914-e0dcd3f79d81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:13.792292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-027e51c6-8e95-43ab-8914-e0dcd3f79d81 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.185998 Jun 16 11:59:13.792919 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 234/452] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:13 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:14.009988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:14.010594 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:14.023119 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:14.023561 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:14.024371 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:14.024799 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:14.164928 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:14.174691 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:14.176408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:14.177733 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-11d24a7d-1649-42b3-9ffb-4df8821f591f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.171713 Jun 16 11:59:14.187903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 219/453] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:14 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:14.255714 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0ffd1e73-b7e7-4e92-9a8e-1d79c5c1b1b2 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:14.257127 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0ffd1e73-b7e7-4e92-9a8e-1d79c5c1b1b2 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:14.264303 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0ffd1e73-b7e7-4e92-9a8e-1d79c5c1b1b2 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:14.264739 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0ffd1e73-b7e7-4e92-9a8e-1d79c5c1b1b2 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:14.265690 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0ffd1e73-b7e7-4e92-9a8e-1d79c5c1b1b2 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:14.266114 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0ffd1e73-b7e7-4e92-9a8e-1d79c5c1b1b2 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:14.397538 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0ffd1e73-b7e7-4e92-9a8e-1d79c5c1b1b2 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:14.405563 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0ffd1e73-b7e7-4e92-9a8e-1d79c5c1b1b2 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.154184 Jun 16 11:59:14.406122 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 235/454] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:14 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:14.621997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5d4f2446-466c-4f61-9b41-f31c6611fc27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:14.622865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5d4f2446-466c-4f61-9b41-f31c6611fc27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:14.629270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d4f2446-466c-4f61-9b41-f31c6611fc27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:14.629709 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d4f2446-466c-4f61-9b41-f31c6611fc27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:14.630464 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d4f2446-466c-4f61-9b41-f31c6611fc27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:14.630887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5d4f2446-466c-4f61-9b41-f31c6611fc27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:14.791573 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5d4f2446-466c-4f61-9b41-f31c6611fc27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:14.800257 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5d4f2446-466c-4f61-9b41-f31c6611fc27 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.182102 Jun 16 11:59:14.800839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 220/455] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:14 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:14.809852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ee82c7eb-0c75-4e0a-ae21-5e5a9bb7376c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:14.810757 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ee82c7eb-0c75-4e0a-ae21-5e5a9bb7376c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:14.817342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ee82c7eb-0c75-4e0a-ae21-5e5a9bb7376c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:14.817900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ee82c7eb-0c75-4e0a-ae21-5e5a9bb7376c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:14.819073 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ee82c7eb-0c75-4e0a-ae21-5e5a9bb7376c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:14.819385 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ee82c7eb-0c75-4e0a-ae21-5e5a9bb7376c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:14.958064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ee82c7eb-0c75-4e0a-ae21-5e5a9bb7376c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:14.967083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ee82c7eb-0c75-4e0a-ae21-5e5a9bb7376c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.161619 Jun 16 11:59:14.968180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 236/456] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:14 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:15.197045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:15.197609 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:15.204101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:15.204550 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:15.205471 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:15.205908 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:15.342262 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:15.351586 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:15.353280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:15.354551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2e14165e-c0e8-42e2-a12f-688019615935 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.161476 Jun 16 11:59:15.355215 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 221/457] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:15 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:59:15.422639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-50d8b06c-1bfe-4bc4-b027-ecebfe5db9ea tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:15.423288 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-50d8b06c-1bfe-4bc4-b027-ecebfe5db9ea tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:15.430021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50d8b06c-1bfe-4bc4-b027-ecebfe5db9ea tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:15.430468 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50d8b06c-1bfe-4bc4-b027-ecebfe5db9ea tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:15.431318 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50d8b06c-1bfe-4bc4-b027-ecebfe5db9ea tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:15.431774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50d8b06c-1bfe-4bc4-b027-ecebfe5db9ea tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:15.568800 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-50d8b06c-1bfe-4bc4-b027-ecebfe5db9ea tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:15.577842 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-50d8b06c-1bfe-4bc4-b027-ecebfe5db9ea tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.158921 Jun 16 11:59:15.578421 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 237/458] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:15 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:15.818583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-93928b90-7eed-42e6-9b96-39670a8c4e16 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:15.819258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-93928b90-7eed-42e6-9b96-39670a8c4e16 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:15.826358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-93928b90-7eed-42e6-9b96-39670a8c4e16 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:15.826965 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-93928b90-7eed-42e6-9b96-39670a8c4e16 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:15.827821 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-93928b90-7eed-42e6-9b96-39670a8c4e16 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:15.828350 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-93928b90-7eed-42e6-9b96-39670a8c4e16 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:15.832928 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=100 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:15.985408 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7f04e5c3-cbbe-46d5-857c-4e29a714f487 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:15.988240 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7f04e5c3-cbbe-46d5-857c-4e29a714f487 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:15.993510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7f04e5c3-cbbe-46d5-857c-4e29a714f487 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:15.994714 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7f04e5c3-cbbe-46d5-857c-4e29a714f487 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:15.995487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7f04e5c3-cbbe-46d5-857c-4e29a714f487 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:15.995968 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7f04e5c3-cbbe-46d5-857c-4e29a714f487 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:16.001779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-93928b90-7eed-42e6-9b96-39670a8c4e16 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:16.011064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-93928b90-7eed-42e6-9b96-39670a8c4e16 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.196449 Jun 16 11:59:16.011633 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 222/459] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:15 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:16.133247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7f04e5c3-cbbe-46d5-857c-4e29a714f487 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:16.140969 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7f04e5c3-cbbe-46d5-857c-4e29a714f487 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.160077 Jun 16 11:59:16.141774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 238/460] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:15 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:16.374436 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:16.375739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:16.382615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:16.383058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:16.383940 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:16.384376 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:16.517742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:16.528554 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:16.530288 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:16.531589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0ba2e830-1d79-4840-8ac0-9ce9ccb16aea tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.162247 Jun 16 11:59:16.532252 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 223/461] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:16 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:16.594755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-19a6775f-cd1c-40ce-88be-b885bfde0ed5 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:16.595363 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-19a6775f-cd1c-40ce-88be-b885bfde0ed5 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:16.602288 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-19a6775f-cd1c-40ce-88be-b885bfde0ed5 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:16.602762 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-19a6775f-cd1c-40ce-88be-b885bfde0ed5 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:16.604494 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-19a6775f-cd1c-40ce-88be-b885bfde0ed5 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:16.604699 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-19a6775f-cd1c-40ce-88be-b885bfde0ed5 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:16.751496 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-19a6775f-cd1c-40ce-88be-b885bfde0ed5 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:16.760508 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-19a6775f-cd1c-40ce-88be-b885bfde0ed5 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.169790 Jun 16 11:59:16.761262 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 239/462] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:16 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:17.028288 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d544330a-dcec-4381-9655-3e9e76bf2d4c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:17.029064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d544330a-dcec-4381-9655-3e9e76bf2d4c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:17.035358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d544330a-dcec-4381-9655-3e9e76bf2d4c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:17.035890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d544330a-dcec-4381-9655-3e9e76bf2d4c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:17.036802 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d544330a-dcec-4381-9655-3e9e76bf2d4c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:17.037304 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d544330a-dcec-4381-9655-3e9e76bf2d4c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:17.157688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-68b6e8dc-666a-4086-95e2-675892881777 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:17.158317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-68b6e8dc-666a-4086-95e2-675892881777 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:17.164258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-68b6e8dc-666a-4086-95e2-675892881777 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:17.164702 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-68b6e8dc-666a-4086-95e2-675892881777 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:17.165465 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-68b6e8dc-666a-4086-95e2-675892881777 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:17.165928 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-68b6e8dc-666a-4086-95e2-675892881777 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:17.182533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d544330a-dcec-4381-9655-3e9e76bf2d4c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:17.191222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d544330a-dcec-4381-9655-3e9e76bf2d4c tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.166709 Jun 16 11:59:17.193687 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 224/463] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:17 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:17.316395 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-68b6e8dc-666a-4086-95e2-675892881777 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:17.326499 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-68b6e8dc-666a-4086-95e2-675892881777 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.172613 Jun 16 11:59:17.327082 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 240/464] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:17 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:17.551935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:17.553212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:17.560335 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:17.561026 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:17.561863 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:17.562377 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:17.706233 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:17.715916 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:17.717552 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:17.719014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-16f1f48d-b94e-4588-8701-58fe2edfb301 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.171447 Jun 16 11:59:17.719521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 225/465] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:17 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:59:17.777031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-aa6c325c-b42d-4822-ad95-746467308c27 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:17.777635 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-aa6c325c-b42d-4822-ad95-746467308c27 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:17.784050 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-aa6c325c-b42d-4822-ad95-746467308c27 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:17.784491 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-aa6c325c-b42d-4822-ad95-746467308c27 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:17.785243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-aa6c325c-b42d-4822-ad95-746467308c27 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:17.785667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-aa6c325c-b42d-4822-ad95-746467308c27 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:17.922476 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-aa6c325c-b42d-4822-ad95-746467308c27 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:17.929759 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-aa6c325c-b42d-4822-ad95-746467308c27 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.156540 Jun 16 11:59:17.930305 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 241/466] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:17 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:18.208467 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-dbaa5d3a-8ad7-43da-a18d-70b4f9498858 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:18.209167 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-dbaa5d3a-8ad7-43da-a18d-70b4f9498858 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:18.215183 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dbaa5d3a-8ad7-43da-a18d-70b4f9498858 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:18.215625 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dbaa5d3a-8ad7-43da-a18d-70b4f9498858 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:18.216429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dbaa5d3a-8ad7-43da-a18d-70b4f9498858 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:18.216863 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dbaa5d3a-8ad7-43da-a18d-70b4f9498858 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:18.342658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-81ff35df-cc86-4984-b782-32919a71b635 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:18.343680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-81ff35df-cc86-4984-b782-32919a71b635 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:18.349697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81ff35df-cc86-4984-b782-32919a71b635 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:18.350312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81ff35df-cc86-4984-b782-32919a71b635 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:18.351080 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81ff35df-cc86-4984-b782-32919a71b635 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:18.351512 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81ff35df-cc86-4984-b782-32919a71b635 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:18.359672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-dbaa5d3a-8ad7-43da-a18d-70b4f9498858 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:18.367748 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-dbaa5d3a-8ad7-43da-a18d-70b4f9498858 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.163091 Jun 16 11:59:18.368618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 226/467] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:18 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:18.478869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-81ff35df-cc86-4984-b782-32919a71b635 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:18.486313 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-81ff35df-cc86-4984-b782-32919a71b635 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.147625 Jun 16 11:59:18.486877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 242/468] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:18 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:18.737148 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:18.737744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:18.744124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:18.748669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:18.748669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:18.748669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:18.881529 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:18.890872 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:18.893202 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:18.893539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-be0d002e-1f2b-4533-8b07-9b6dac6d6621 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.160368 Jun 16 11:59:18.894094 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 227/469] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:18 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:18.946623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2fce3c89-d16e-462c-865a-bd9e49827c46 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:18.947730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2fce3c89-d16e-462c-865a-bd9e49827c46 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:18.954079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2fce3c89-d16e-462c-865a-bd9e49827c46 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:18.954653 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2fce3c89-d16e-462c-865a-bd9e49827c46 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:18.955433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2fce3c89-d16e-462c-865a-bd9e49827c46 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:18.955861 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2fce3c89-d16e-462c-865a-bd9e49827c46 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:19.083181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2fce3c89-d16e-462c-865a-bd9e49827c46 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:19.091180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2fce3c89-d16e-462c-865a-bd9e49827c46 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1314 microversion: 2.1 time: 0.148650 Jun 16 11:59:19.091733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 243/470] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:18 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:19.385652 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e0fd53e7-dba7-4ad5-8243-67c95e4a5418 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:19.386260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e0fd53e7-dba7-4ad5-8243-67c95e4a5418 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:19.392229 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e0fd53e7-dba7-4ad5-8243-67c95e4a5418 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:19.392667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e0fd53e7-dba7-4ad5-8243-67c95e4a5418 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:19.393407 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e0fd53e7-dba7-4ad5-8243-67c95e4a5418 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:19.393830 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e0fd53e7-dba7-4ad5-8243-67c95e4a5418 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:19.503276 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9f157140-b320-4f38-8e06-0d5849e0c63b tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:19.504303 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9f157140-b320-4f38-8e06-0d5849e0c63b tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:19.512444 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9f157140-b320-4f38-8e06-0d5849e0c63b tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:19.513338 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9f157140-b320-4f38-8e06-0d5849e0c63b tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:19.514264 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9f157140-b320-4f38-8e06-0d5849e0c63b tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:19.514965 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9f157140-b320-4f38-8e06-0d5849e0c63b tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:19.538709 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e0fd53e7-dba7-4ad5-8243-67c95e4a5418 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:19.546693 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e0fd53e7-dba7-4ad5-8243-67c95e4a5418 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1758 microversion: 2.1 time: 0.165421 Jun 16 11:59:19.547540 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 228/471] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:19 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:19.654190 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9f157140-b320-4f38-8e06-0d5849e0c63b tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:19.661599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9f157140-b320-4f38-8e06-0d5849e0c63b tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.162473 Jun 16 11:59:19.662153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 244/472] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:19 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:19.912760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:19.913287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:19.920174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:19.920617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:19.921376 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:19.921807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.048195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:20.058451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:20.058659 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:20.060658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3bb7cbf2-1fd9-4025-8dad-762d6f04c256 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.150950 Jun 16 11:59:20.060658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 229/473] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:19 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:20.107666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f47a2ec3-9e75-46c9-aedc-f3d8f3b938f1 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:20.108365 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f47a2ec3-9e75-46c9-aedc-f3d8f3b938f1 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:20.115399 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f47a2ec3-9e75-46c9-aedc-f3d8f3b938f1 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.115895 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f47a2ec3-9e75-46c9-aedc-f3d8f3b938f1 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.116674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f47a2ec3-9e75-46c9-aedc-f3d8f3b938f1 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.117139 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f47a2ec3-9e75-46c9-aedc-f3d8f3b938f1 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.241932 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f47a2ec3-9e75-46c9-aedc-f3d8f3b938f1 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:20.249317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f47a2ec3-9e75-46c9-aedc-f3d8f3b938f1 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1464 microversion: 2.1 time: 0.146252 Jun 16 11:59:20.249898 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 245/474] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:20 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:20.287820 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c3cfa6ed-69ea-421a-8faa-75a710bfe413 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:20.288364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c3cfa6ed-69ea-421a-8faa-75a710bfe413 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:20.294940 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c3cfa6ed-69ea-421a-8faa-75a710bfe413 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.295380 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c3cfa6ed-69ea-421a-8faa-75a710bfe413 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.296169 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c3cfa6ed-69ea-421a-8faa-75a710bfe413 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.296602 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c3cfa6ed-69ea-421a-8faa-75a710bfe413 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.320003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c3cfa6ed-69ea-421a-8faa-75a710bfe413 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Going to try to terminate instance {{(pid=125055) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 11:59:20.561617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c3cfa6ed-69ea-421a-8faa-75a710bfe413 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 204 len: 0 microversion: 2.1 time: 0.277324 Jun 16 11:59:20.562298 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 230/475] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 11:59:20 2022] DELETE /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 11:59:20.564094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3441edfe-cd30-46b6-a871-743bb3f333f6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:20.564696 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3441edfe-cd30-46b6-a871-743bb3f333f6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:20.570665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-91702370-1e98-4a26-8171-302a508f839f tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:20.571177 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3441edfe-cd30-46b6-a871-743bb3f333f6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.571492 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3441edfe-cd30-46b6-a871-743bb3f333f6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.572250 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-91702370-1e98-4a26-8171-302a508f839f tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:20.572777 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3441edfe-cd30-46b6-a871-743bb3f333f6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.573207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3441edfe-cd30-46b6-a871-743bb3f333f6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.580093 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-91702370-1e98-4a26-8171-302a508f839f tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.580662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-91702370-1e98-4a26-8171-302a508f839f tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.581434 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-91702370-1e98-4a26-8171-302a508f839f tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.581864 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-91702370-1e98-4a26-8171-302a508f839f tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.729181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3441edfe-cd30-46b6-a871-743bb3f333f6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:20.737853 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3441edfe-cd30-46b6-a871-743bb3f333f6 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1761 microversion: 2.1 time: 0.177525 Jun 16 11:59:20.738350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 246/476] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:20 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1761 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:20.742970 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-12e812a7-735d-4b14-97f8-df638d4d0407 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:20.744246 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-12e812a7-735d-4b14-97f8-df638d4d0407 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:20.750281 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-12e812a7-735d-4b14-97f8-df638d4d0407 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.750729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-12e812a7-735d-4b14-97f8-df638d4d0407 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.751495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-12e812a7-735d-4b14-97f8-df638d4d0407 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:20.751947 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-12e812a7-735d-4b14-97f8-df638d4d0407 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:20.776871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-91702370-1e98-4a26-8171-302a508f839f tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:20.784987 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-91702370-1e98-4a26-8171-302a508f839f tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1470 microversion: 2.1 time: 0.218318 Jun 16 11:59:20.785890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 231/477] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:20 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:20.888675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-12e812a7-735d-4b14-97f8-df638d4d0407 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:20.899577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-12e812a7-735d-4b14-97f8-df638d4d0407 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.156786 Jun 16 11:59:20.899577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 247/478] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:20 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:21.078458 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:21.079120 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:21.085596 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:21.086039 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:21.086795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:21.087280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:21.219585 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:21.228506 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:21.229999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:21.231157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-94e53458-d840-4239-9b60-2897a5445006 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.156574 Jun 16 11:59:21.231724 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 232/479] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:21 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:21.803220 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6180dd07-5f7e-4ead-854b-693feeb43941 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:21.803861 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6180dd07-5f7e-4ead-854b-693feeb43941 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:21.810893 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6180dd07-5f7e-4ead-854b-693feeb43941 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:21.811333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6180dd07-5f7e-4ead-854b-693feeb43941 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:21.812136 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6180dd07-5f7e-4ead-854b-693feeb43941 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:21.812569 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6180dd07-5f7e-4ead-854b-693feeb43941 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:21.913887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-432943d2-b91d-41c0-85ce-4f63dc8d7cda tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:21.914519 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-432943d2-b91d-41c0-85ce-4f63dc8d7cda tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:21.920415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-432943d2-b91d-41c0-85ce-4f63dc8d7cda tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:21.920849 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-432943d2-b91d-41c0-85ce-4f63dc8d7cda tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:21.921597 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-432943d2-b91d-41c0-85ce-4f63dc8d7cda tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:21.922022 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-432943d2-b91d-41c0-85ce-4f63dc8d7cda tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:21.942086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6180dd07-5f7e-4ead-854b-693feeb43941 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:21.949874 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6180dd07-5f7e-4ead-854b-693feeb43941 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1470 microversion: 2.1 time: 0.150536 Jun 16 11:59:21.950568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 248/480] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:21 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:22.049301 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-432943d2-b91d-41c0-85ce-4f63dc8d7cda tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:22.056660 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-432943d2-b91d-41c0-85ce-4f63dc8d7cda tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.146533 Jun 16 11:59:22.057223 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 233/481] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:21 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:22.249896 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:22.253316 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:22.256786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:22.257233 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:22.257993 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:22.258428 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:22.386207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:22.394504 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:22.396017 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:22.397162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-54a1d249-b784-4af3-92bc-516cd0e01223 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.151193 Jun 16 11:59:22.397718 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 249/482] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:22 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:59:22.966387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5a7a9a9d-be4b-4286-97b6-740340607a10 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:22.967010 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5a7a9a9d-be4b-4286-97b6-740340607a10 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:22.973763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a7a9a9d-be4b-4286-97b6-740340607a10 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:22.974197 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a7a9a9d-be4b-4286-97b6-740340607a10 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:22.974950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a7a9a9d-be4b-4286-97b6-740340607a10 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:22.975376 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5a7a9a9d-be4b-4286-97b6-740340607a10 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:23.073559 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a608e57b-c5ed-437e-a0ab-07e73e8ebf43 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:23.074159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a608e57b-c5ed-437e-a0ab-07e73e8ebf43 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:23.080622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a608e57b-c5ed-437e-a0ab-07e73e8ebf43 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:23.081059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a608e57b-c5ed-437e-a0ab-07e73e8ebf43 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:23.081812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a608e57b-c5ed-437e-a0ab-07e73e8ebf43 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:23.082243 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a608e57b-c5ed-437e-a0ab-07e73e8ebf43 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:23.203100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5a7a9a9d-be4b-4286-97b6-740340607a10 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:23.211737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5a7a9a9d-be4b-4286-97b6-740340607a10 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1470 microversion: 2.1 time: 0.248943 Jun 16 11:59:23.213188 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 234/483] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:22 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:23.215846 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a608e57b-c5ed-437e-a0ab-07e73e8ebf43 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:23.224128 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a608e57b-c5ed-437e-a0ab-07e73e8ebf43 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1313 microversion: 2.1 time: 0.154309 Jun 16 11:59:23.224691 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 250/484] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:23 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:23.415623 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:23.416248 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:23.422227 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:23.422669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:23.423422 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:23.423850 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:23.613631 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-82a07a8f-4063-40ca-9d68-1cac86fd7701 req-989caeac-590c-42f8-879e-8075a4e5c9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc6b840-6f8e-4073-9ddd-9fe71329c594", "name": "network-vif-deleted", "tag": "b6c3db1b-87a4-4647-b2ae-1f5fdffcc556"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:23.622112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-82a07a8f-4063-40ca-9d68-1cac86fd7701 req-989caeac-590c-42f8-879e-8075a4e5c9bd service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:23.622552 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-82a07a8f-4063-40ca-9d68-1cac86fd7701 req-989caeac-590c-42f8-879e-8075a4e5c9bd service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:23.626633 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:23.629765 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:23.634473 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-82a07a8f-4063-40ca-9d68-1cac86fd7701 req-989caeac-590c-42f8-879e-8075a4e5c9bd service nova] Creating event network-vif-deleted:b6c3db1b-87a4-4647-b2ae-1f5fdffcc556 for instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 on hv-cinder-84614 Jun 16 11:59:23.639997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:23.642099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:23.642959 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e94557f2-544a-4756-82e9-b74afb3afc1b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.231246 Jun 16 11:59:23.643598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 235/485] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:23 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:23.645292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-82a07a8f-4063-40ca-9d68-1cac86fd7701 req-989caeac-590c-42f8-879e-8075a4e5c9bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035250 Jun 16 11:59:23.646025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 251/486] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:59:24.229347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:24.229961 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:24.236514 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:24.236958 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:24.237716 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:24.238149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:24.242417 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-219f429d-3a12-4c4c-8205-10b750e87d08 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:24.243364 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-219f429d-3a12-4c4c-8205-10b750e87d08 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:24.249658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-219f429d-3a12-4c4c-8205-10b750e87d08 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:24.250105 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-219f429d-3a12-4c4c-8205-10b750e87d08 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:24.250889 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-219f429d-3a12-4c4c-8205-10b750e87d08 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:24.251352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-219f429d-3a12-4c4c-8205-10b750e87d08 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:24.269745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:24.270131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:24.270572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lazy-loading 'fault' on Instance uuid dbc6b840-6f8e-4073-9ddd-9fe71329c594 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:59:24.317085 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32560e5ffa640d0b505834f090bd330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6602646a8734415a2cd5c138ec99b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:24.319393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:24.326031 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fb66cf65-fa79-4c63-95df-8f02ec2f3945 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 200 len: 1304 microversion: 2.1 time: 0.100486 Jun 16 11:59:24.330159 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 236/487] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:24 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:24.380352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-219f429d-3a12-4c4c-8205-10b750e87d08 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:24.388272 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-219f429d-3a12-4c4c-8205-10b750e87d08 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1496 microversion: 2.1 time: 0.150774 Jun 16 11:59:24.389012 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 252/488] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:24 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:24.662622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:24.663221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:24.670235 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:24.670680 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:24.671431 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:24.671911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:24.800759 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:24.809439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:24.810931 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:24.812126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c7752d37-4ea9-4137-9956-cb86059439f4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.153413 Jun 16 11:59:24.812670 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 237/489] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:24 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:25.291728 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0f15b67f-9dd5-45c5-9a18-0fb8be887063 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:25.292247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0f15b67f-9dd5-45c5-9a18-0fb8be887063 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:25.298608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f15b67f-9dd5-45c5-9a18-0fb8be887063 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:25.299048 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f15b67f-9dd5-45c5-9a18-0fb8be887063 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:25.299804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f15b67f-9dd5-45c5-9a18-0fb8be887063 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:25.300272 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f15b67f-9dd5-45c5-9a18-0fb8be887063 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:25.324203 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0f15b67f-9dd5-45c5-9a18-0fb8be887063 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 11:59:25.343148 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:25.344126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] [instance: dbc6b840-6f8e-4073-9ddd-9fe71329c594] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:25.350686 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:25.351134 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:25.351918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:25.352358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:25.366440 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] HTTP exception thrown: Instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 could not be found. Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Request method failure captured: Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 HTTP/1.1 Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxr1UF59DedszJS_Vw4JQDdZ38Gt_wmS_QiYLIFD9M-U6KS5bPAMGmPYk6ONagkH27uqGzoJ5i7RNVpaUcT7csAm2BFJA5K3qOud8s5_rVKeKVfzyQWA-mRP-ffwKQywpkol58nsXbtNl9xmwiAjOsBp-9l1x_CeZ1TRhXWY3F4xSz8 Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: c6602646a8734415a2cd5c138ec99b29 Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesNegativeTest-1116799540 Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 11:59:25.368092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c6602646a8734415a2cd5c138ec99b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c6602646a8734415a2cd5c138ec99b29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6602646a8734415a2cd5c138ec99b29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6602646a8734415a2cd5c138ec99b29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesNegativeTest-1116799540 Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: c6602646a8734415a2cd5c138ec99b29 Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesNegativeTest-1116799540 Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesNegativeTest-1116799540-project Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: e32560e5ffa640d0b505834f090bd330 Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesNegativeTest-1116799540-project Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 could not be found. Jun 16 11:59:25.369600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': 'dbc6b840-6f8e-4073-9ddd-9fe71329c594'} Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 could not be found. Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:59:25.370551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 could not be found. Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 could not be found. Jun 16 11:59:25.373919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:25.375246 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] Returning 404 to user: Instance dbc6b840-6f8e-4073-9ddd-9fe71329c594 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:59:25.375246 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-df4aaa15-99c1-4644-b281-6a2dd7f846c4 tempest-VolumesNegativeTest-1116799540 tempest-VolumesNegativeTest-1116799540-project] 10.222.0.40 "GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594" status: 404 len: 111 microversion: 2.1 time: 0.030493 Jun 16 11:59:25.375246 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 238/490] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:25 2022] GET /compute/v2.1/servers/dbc6b840-6f8e-4073-9ddd-9fe71329c594 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 11:59:25.619488 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0f15b67f-9dd5-45c5-9a18-0fb8be887063 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 204 len: 0 microversion: 2.1 time: 0.331941 Jun 16 11:59:25.620122 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 253/491] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 11:59:25 2022] DELETE /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 11:59:25.628272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f27e6d53-b022-4c97-aba1-1697a83ec679 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:25.628909 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f27e6d53-b022-4c97-aba1-1697a83ec679 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:25.635537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f27e6d53-b022-4c97-aba1-1697a83ec679 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:25.636035 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f27e6d53-b022-4c97-aba1-1697a83ec679 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:25.636779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f27e6d53-b022-4c97-aba1-1697a83ec679 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:25.637212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f27e6d53-b022-4c97-aba1-1697a83ec679 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:25.776991 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f27e6d53-b022-4c97-aba1-1697a83ec679 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:25.784528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f27e6d53-b022-4c97-aba1-1697a83ec679 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1502 microversion: 2.1 time: 0.160241 Jun 16 11:59:25.785096 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 239/492] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:25 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:25.830785 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:25.831595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:25.838301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:25.838741 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:25.839498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:25.839956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:25.972670 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:25.981124 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:25.982637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:25.983758 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-016b21d5-65f5-45b1-992d-0ebe3ab9fa5e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.157149 Jun 16 11:59:25.984343 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 254/493] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:25 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:26.801588 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4189d851-1fde-4720-b4b4-c636bfa0c488 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:26.802148 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4189d851-1fde-4720-b4b4-c636bfa0c488 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:26.808821 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4189d851-1fde-4720-b4b4-c636bfa0c488 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:26.809264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4189d851-1fde-4720-b4b4-c636bfa0c488 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:26.810005 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4189d851-1fde-4720-b4b4-c636bfa0c488 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:26.810431 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4189d851-1fde-4720-b4b4-c636bfa0c488 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:26.939052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4189d851-1fde-4720-b4b4-c636bfa0c488 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:26.947056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4189d851-1fde-4720-b4b4-c636bfa0c488 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1502 microversion: 2.1 time: 0.149381 Jun 16 11:59:26.948008 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 240/494] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:26 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:27.002395 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:27.002995 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:27.009576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:27.010020 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:27.010904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:27.011362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:27.142458 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:27.151599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:27.153195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:27.155489 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6d9c15de-f664-4188-9637-98462ef69696 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.156893 Jun 16 11:59:27.156094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 255/495] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:26 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:27.963349 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-37b68eff-c1b7-440f-be2a-a3c225885368 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:27.963978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-37b68eff-c1b7-440f-be2a-a3c225885368 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:27.970810 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-37b68eff-c1b7-440f-be2a-a3c225885368 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:27.971251 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-37b68eff-c1b7-440f-be2a-a3c225885368 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:27.972033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-37b68eff-c1b7-440f-be2a-a3c225885368 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:27.972466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-37b68eff-c1b7-440f-be2a-a3c225885368 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:28.100421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-37b68eff-c1b7-440f-be2a-a3c225885368 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:28.108599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-37b68eff-c1b7-440f-be2a-a3c225885368 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1502 microversion: 2.1 time: 0.149065 Jun 16 11:59:28.109165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 241/496] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:27 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:28.173489 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:28.174038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:28.180639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:28.181685 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:28.182438 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:28.182967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:28.313832 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:28.322576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:28.324127 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:28.325280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-100d48b9-9dad-4eb6-883b-784596a60ca4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.155687 Jun 16 11:59:28.325839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 256/497] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:28 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:28.772631 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-6c2b8e2c-878f-416b-ae83-2145766a37fb req-533b5173-afbd-4313-818d-55183a57053e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d58de02-4dec-4af2-a327-cf3b33d46a4a", "name": "network-vif-deleted", "tag": "0eda747e-b9b5-4d0c-9268-0e34cbb2bce3"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:28.781526 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-6c2b8e2c-878f-416b-ae83-2145766a37fb req-533b5173-afbd-4313-818d-55183a57053e service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:28.786579 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-6c2b8e2c-878f-416b-ae83-2145766a37fb req-533b5173-afbd-4313-818d-55183a57053e service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:28.793421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-6c2b8e2c-878f-416b-ae83-2145766a37fb req-533b5173-afbd-4313-818d-55183a57053e service nova] Creating event network-vif-deleted:0eda747e-b9b5-4d0c-9268-0e34cbb2bce3 for instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a on hv-cinder-84614 Jun 16 11:59:28.798223 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-6c2b8e2c-878f-416b-ae83-2145766a37fb req-533b5173-afbd-4313-818d-55183a57053e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029277 Jun 16 11:59:28.798803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 242/498] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:59:29.125410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:29.127089 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:29.132060 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:29.132512 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:29.133274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:29.133762 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:29.162575 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:29.166370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:29.166897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:29.167267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lazy-loading 'fault' on Instance uuid 5d58de02-4dec-4af2-a327-cf3b33d46a4a {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:59:29.215612 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:29.226092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-af16ff60-5100-423a-bc78-ed18710474d4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 200 len: 1303 microversion: 2.1 time: 0.104597 Jun 16 11:59:29.235742 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 257/499] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:29 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:29.344690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:29.345389 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:29.351612 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:29.352098 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:29.352897 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:29.353329 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:29.482992 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:29.491470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:29.492990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:29.494693 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4ad012e9-d39c-44a5-91ca-45b4d6d7e9c6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.155300 Jun 16 11:59:29.495243 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 243/500] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:29 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:30.242450 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:30.243080 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 5d58de02-4dec-4af2-a327-cf3b33d46a4a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:30.249877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:30.250319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:30.251068 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:30.251496 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:30.265209 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] HTTP exception thrown: Instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a could not be found. Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Request method failure captured: Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a HTTP/1.1 Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxrzSvAYRzmly7cMUaLLLW0chvKH4rRUY3-uJMkKXjnN_Z9BK8PSt2utjKQnAbeUW9rI5srYN3mVh8UQ5fRJ_PpcDrtJk-ridTt8JnClsqmrr1Q00q_aVNYawLri8Y1ipBfK7jxEzI07ChJdtmLKpTW5JvBs_YgnjMhptCj4SoHn7Os Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 1c8858f51824444782c874f15da7b16b Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-VolumesActionsTest-1749508694 Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 11:59:30.266820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c8858f51824444782c874f15da7b16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c8858f51824444782c874f15da7b16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c8858f51824444782c874f15da7b16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c8858f51824444782c874f15da7b16b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-VolumesActionsTest-1749508694 Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 1c8858f51824444782c874f15da7b16b Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-VolumesActionsTest-1749508694 Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-VolumesActionsTest-1749508694-project Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 9082354c3ab249f885e129b86799e508 Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-VolumesActionsTest-1749508694-project Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a could not be found. Jun 16 11:59:30.268320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '5d58de02-4dec-4af2-a327-cf3b33d46a4a'} Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a could not be found. Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:59:30.269212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a could not be found. Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a could not be found. Jun 16 11:59:30.270548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 11:59:30.271786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Returning 404 to user: Instance 5d58de02-4dec-4af2-a327-cf3b33d46a4a could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:59:30.271786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-37c4400c-4ed1-46f4-88aa-cdf10c86ee8e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a" status: 404 len: 111 microversion: 2.1 time: 0.029625 Jun 16 11:59:30.271786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 258/501] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:30 2022] GET /compute/v2.1/servers/5d58de02-4dec-4af2-a327-cf3b33d46a4a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 11:59:30.366417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-512148415", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "networks": [{"uuid": "4945d533-61d1-4e27-8c6c-6c8c92bbcce5"}]}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:30.417866 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] validate_networks() for [('4945d533-61d1-4e27-8c6c-6c8c92bbcce5', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:59:30.513977 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:30.514615 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:30.520852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:30.521291 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:30.522061 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:30.522487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:30.662635 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:30.672443 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:30.674470 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:30.675856 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-511d5e41-40be-4064-bc04-1932b7e0c7f9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.165964 Jun 16 11:59:30.680112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 259/502] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:30 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:59:30.983335 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:59:30.983745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:59:30.984236 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:59:30.984637 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:59:30.985038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:59:30.994545 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:30.994986 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:30.995764 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:30.996214 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:31.013181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Getting quotas for project 1c8858f51824444782c874f15da7b16b. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:59:31.017178 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Getting quotas for user 9082354c3ab249f885e129b86799e508 and project 1c8858f51824444782c874f15da7b16b. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:59:31.028019 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:59:31.030276 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:59:31.151018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-846b4a32-b283-4da9-91c9-eac855f905a7 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788207 Jun 16 11:59:31.151642 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 244/503] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 11:59:31.163424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d342f0d9-19ef-4da7-860b-b60c387b0ca4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:31.163424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d342f0d9-19ef-4da7-860b-b60c387b0ca4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:31.240390 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d342f0d9-19ef-4da7-860b-b60c387b0ca4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:31.254202 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d342f0d9-19ef-4da7-860b-b60c387b0ca4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1213 microversion: 2.1 time: 0.095760 Jun 16 11:59:31.277100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 260/504] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:31 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:31.695204 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:31.695808 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:31.698419 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:31.703722 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:31.704186 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:31.705915 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:31.705915 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:31.838228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:31.847069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:31.848723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:31.851699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-82095f3d-3175-4bf3-8cd5-295b371389f2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.159021 Jun 16 11:59:31.851699 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 245/505] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:31 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:32.273276 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-687d0e8c-1538-4c89-b5e5-9a410502383f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:32.273878 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-687d0e8c-1538-4c89-b5e5-9a410502383f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:32.280733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-687d0e8c-1538-4c89-b5e5-9a410502383f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:32.281173 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-687d0e8c-1538-4c89-b5e5-9a410502383f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:32.281926 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-687d0e8c-1538-4c89-b5e5-9a410502383f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:32.282352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-687d0e8c-1538-4c89-b5e5-9a410502383f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:32.348433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-687d0e8c-1538-4c89-b5e5-9a410502383f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:32.353525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-687d0e8c-1538-4c89-b5e5-9a410502383f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1209 microversion: 2.1 time: 0.084896 Jun 16 11:59:32.354079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 261/506] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:32 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:32.733111 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-51416f58-b701-4ce0-a3a1-f253c890b948 req-0676edf1-75be-46a5-afee-a3a6b6d31352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6646f09a-70e9-487b-98f0-89ab1fe5508a", "name": "network-vif-plugged", "status": "completed", "tag": "e8a94066-1a49-45d0-9264-0c1a6dbdacde"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:32.742534 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-51416f58-b701-4ce0-a3a1-f253c890b948 req-0676edf1-75be-46a5-afee-a3a6b6d31352 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:32.743583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-51416f58-b701-4ce0-a3a1-f253c890b948 req-0676edf1-75be-46a5-afee-a3a6b6d31352 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:32.756636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-51416f58-b701-4ce0-a3a1-f253c890b948 req-0676edf1-75be-46a5-afee-a3a6b6d31352 service nova] Creating event network-vif-plugged:e8a94066-1a49-45d0-9264-0c1a6dbdacde for instance 6646f09a-70e9-487b-98f0-89ab1fe5508a on hv-cinder-84614 Jun 16 11:59:32.761632 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-51416f58-b701-4ce0-a3a1-f253c890b948 req-0676edf1-75be-46a5-afee-a3a6b6d31352 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032488 Jun 16 11:59:32.762451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 246/507] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:59:32.868501 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:32.869438 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:32.878578 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:32.879186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:32.880246 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:32.880783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:33.015430 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:33.024708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:33.026230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:33.027372 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e46bf6a0-fef9-43fa-8d41-b4cf34fe988b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.163513 Jun 16 11:59:33.028383 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 262/508] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:32 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:33.181122 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 11:59:33.181396 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Thu Jun 16 11:59:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 11:59:33.370984 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a0684c59-cfba-419d-85b8-a0269a2f5dc1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:33.371766 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a0684c59-cfba-419d-85b8-a0269a2f5dc1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:33.378750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a0684c59-cfba-419d-85b8-a0269a2f5dc1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:33.379182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a0684c59-cfba-419d-85b8-a0269a2f5dc1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:33.380230 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a0684c59-cfba-419d-85b8-a0269a2f5dc1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:33.380813 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a0684c59-cfba-419d-85b8-a0269a2f5dc1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:33.522892 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a0684c59-cfba-419d-85b8-a0269a2f5dc1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:33.531993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a0684c59-cfba-419d-85b8-a0269a2f5dc1 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1283 microversion: 2.1 time: 0.164686 Jun 16 11:59:33.532795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 247/509] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:33 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:34.047660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:34.048306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:34.057477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:34.058128 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:34.059594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:34.060060 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:34.203240 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:34.212227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:34.213902 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:34.215362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a32837bc-0eae-40d4-9223-4110878284ff tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.172927 Jun 16 11:59:34.226369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 263/510] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:34 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:34.549599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1205672a-3444-4f59-8494-f7eee6955518 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:34.550219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1205672a-3444-4f59-8494-f7eee6955518 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:34.557853 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1205672a-3444-4f59-8494-f7eee6955518 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:34.557853 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1205672a-3444-4f59-8494-f7eee6955518 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:34.558624 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1205672a-3444-4f59-8494-f7eee6955518 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:34.559058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1205672a-3444-4f59-8494-f7eee6955518 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:34.791887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1205672a-3444-4f59-8494-f7eee6955518 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:34.799519 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1205672a-3444-4f59-8494-f7eee6955518 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.254157 Jun 16 11:59:34.800120 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 248/511] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:34 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:35.233775 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:35.234315 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:35.240694 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:35.241132 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:35.241927 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:35.242352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:35.308779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-86eb56ba-ab91-4e08-b5b5-6dc118983d4c req-f708eda4-c84f-456b-aee5-6b6919adebe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63bc42ae-4582-4510-b6ff-fdca91e3c01e", "tag": "1dea0f7a-7cea-4e33-9f1f-783b915bb580"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:35.318788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-86eb56ba-ab91-4e08-b5b5-6dc118983d4c req-f708eda4-c84f-456b-aee5-6b6919adebe4 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:35.319226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-86eb56ba-ab91-4e08-b5b5-6dc118983d4c req-f708eda4-c84f-456b-aee5-6b6919adebe4 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:35.331538 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-86eb56ba-ab91-4e08-b5b5-6dc118983d4c req-f708eda4-c84f-456b-aee5-6b6919adebe4 service nova] Creating event network-changed:1dea0f7a-7cea-4e33-9f1f-783b915bb580 for instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e on hv-cinder-84614 Jun 16 11:59:35.336149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-86eb56ba-ab91-4e08-b5b5-6dc118983d4c req-f708eda4-c84f-456b-aee5-6b6919adebe4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031591 Jun 16 11:59:35.336827 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 249/512] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:59:35.387317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:35.395643 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:35.397134 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:35.398321 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3f4bc89a-6b20-442c-a881-0a3341a6f00b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.168646 Jun 16 11:59:35.398869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 264/513] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:35 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:35.820341 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2d21f970-1ad7-465e-ae0d-44638538523a tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:35.821078 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2d21f970-1ad7-465e-ae0d-44638538523a tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:35.827560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2d21f970-1ad7-465e-ae0d-44638538523a tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:35.828056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2d21f970-1ad7-465e-ae0d-44638538523a tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:35.828888 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2d21f970-1ad7-465e-ae0d-44638538523a tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:35.829246 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2d21f970-1ad7-465e-ae0d-44638538523a tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:35.897177 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-111440467", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "networks": [{"uuid": "f18477c1-13d7-45f2-9ae2-cf7317fba9fc"}]}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:35.954662 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] validate_networks() for [('f18477c1-13d7-45f2-9ae2-cf7317fba9fc', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 11:59:36.058908 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2d21f970-1ad7-465e-ae0d-44638538523a tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:36.067318 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2d21f970-1ad7-465e-ae0d-44638538523a tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.254118 Jun 16 11:59:36.068028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 250/514] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:35 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:36.310089 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 11:59:36.310550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 11:59:36.310967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 11:59:36.311374 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 11:59:36.311780 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 11:59:36.322362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:36.322808 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:36.324683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:36.324683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:36.341256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Getting quotas for project 82c80e6e109741d1bd83c7b81368a87f. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 11:59:36.346359 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Getting quotas for user 5e69fc12fcc34fa39f67dd156cd860a4 and project 82c80e6e109741d1bd83c7b81368a87f. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 11:59:36.357602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 11:59:36.359909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 11:59:36.416610 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:36.417213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:36.423090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:36.423530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:36.424310 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:36.424741 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:36.512835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d0126d34-ab09-4fc0-b8e8-b48b137a4e9f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619426 Jun 16 11:59:36.513481 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 265/515] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 11:59:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 11:59:36.523101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-104fe224-2692-4825-859b-440b7cc05f3a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:36.523720 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-104fe224-2692-4825-859b-440b7cc05f3a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:36.574719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:36.576704 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-104fe224-2692-4825-859b-440b7cc05f3a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:36.583712 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-104fe224-2692-4825-859b-440b7cc05f3a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1218 microversion: 2.1 time: 0.064216 Jun 16 11:59:36.584968 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 266/516] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:36 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:36.585536 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:36.589018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:36.590314 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6e651d7f-ec80-4fa9-bf8a-25c0c251387e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.177648 Jun 16 11:59:36.590943 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 251/517] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:36 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 11:59:37.083299 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4ab854a0-831b-4b7c-9e50-4783a17d079e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:37.083961 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4ab854a0-831b-4b7c-9e50-4783a17d079e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:37.090497 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4ab854a0-831b-4b7c-9e50-4783a17d079e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:37.090935 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4ab854a0-831b-4b7c-9e50-4783a17d079e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:37.091757 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4ab854a0-831b-4b7c-9e50-4783a17d079e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:37.092209 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4ab854a0-831b-4b7c-9e50-4783a17d079e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:37.223298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4ab854a0-831b-4b7c-9e50-4783a17d079e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:37.231454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4ab854a0-831b-4b7c-9e50-4783a17d079e tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.151983 Jun 16 11:59:37.232041 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 267/518] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:37 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:37.601105 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4837c8bc-3bb4-455e-a38b-46e3c6b3034a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:37.601710 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4837c8bc-3bb4-455e-a38b-46e3c6b3034a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:37.608762 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4837c8bc-3bb4-455e-a38b-46e3c6b3034a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:37.609203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4837c8bc-3bb4-455e-a38b-46e3c6b3034a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:37.609951 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4837c8bc-3bb4-455e-a38b-46e3c6b3034a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:37.610375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4837c8bc-3bb4-455e-a38b-46e3c6b3034a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:37.616409 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:37.617049 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:37.623558 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:37.624039 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:37.624813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:37.625246 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:37.682015 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4837c8bc-3bb4-455e-a38b-46e3c6b3034a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:37.690838 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4837c8bc-3bb4-455e-a38b-46e3c6b3034a tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1222 microversion: 2.1 time: 0.093499 Jun 16 11:59:37.691371 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 252/519] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:37 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:37.764733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:37.773622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:37.775750 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:37.777037 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-65e9fd24-5072-468c-abf8-4378bab5d399 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1808 microversion: 2.20 time: 0.164514 Jun 16 11:59:37.777580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 268/520] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:37 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:38.248179 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8b39a503-7a25-403b-8443-bd31f174bc15 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:38.248785 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8b39a503-7a25-403b-8443-bd31f174bc15 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:38.254770 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8b39a503-7a25-403b-8443-bd31f174bc15 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:38.255206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8b39a503-7a25-403b-8443-bd31f174bc15 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:38.256029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8b39a503-7a25-403b-8443-bd31f174bc15 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:38.256387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8b39a503-7a25-403b-8443-bd31f174bc15 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:38.384499 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8b39a503-7a25-403b-8443-bd31f174bc15 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:38.392318 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8b39a503-7a25-403b-8443-bd31f174bc15 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.147845 Jun 16 11:59:38.393107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 253/521] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:38 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:38.708786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7cedc654-c05f-4df2-9a1c-0f064b408e2b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:38.709417 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7cedc654-c05f-4df2-9a1c-0f064b408e2b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:38.716002 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cedc654-c05f-4df2-9a1c-0f064b408e2b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:38.716445 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cedc654-c05f-4df2-9a1c-0f064b408e2b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:38.717198 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cedc654-c05f-4df2-9a1c-0f064b408e2b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:38.717631 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7cedc654-c05f-4df2-9a1c-0f064b408e2b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:38.779162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7cedc654-c05f-4df2-9a1c-0f064b408e2b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:38.782871 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:38.787115 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7cedc654-c05f-4df2-9a1c-0f064b408e2b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1278 microversion: 2.1 time: 0.082377 Jun 16 11:59:38.790467 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 269/522] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:38 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:38.795996 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:38.796602 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:38.803098 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:38.803540 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:38.804496 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:38.804981 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:39.007215 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:39.016685 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:39.018208 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:39.019667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f00c4f17-fd40-4b91-a7da-a1febdee182f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1795 microversion: 2.20 time: 0.227682 Jun 16 11:59:39.020453 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 254/523] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 11:59:38 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1795 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 11:59:39.409143 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-17a311c5-88a4-4884-9ffd-b7c2c5225cf6 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:39.409747 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-17a311c5-88a4-4884-9ffd-b7c2c5225cf6 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:39.416141 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17a311c5-88a4-4884-9ffd-b7c2c5225cf6 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:39.416580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17a311c5-88a4-4884-9ffd-b7c2c5225cf6 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:39.421301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17a311c5-88a4-4884-9ffd-b7c2c5225cf6 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:39.421301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17a311c5-88a4-4884-9ffd-b7c2c5225cf6 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:39.547275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-17a311c5-88a4-4884-9ffd-b7c2c5225cf6 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:39.554666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-17a311c5-88a4-4884-9ffd-b7c2c5225cf6 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.149741 Jun 16 11:59:39.555341 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 270/524] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:39 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:39.804843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b5dd3dd1-3d68-49bb-a0d9-896d6fdc9255 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:39.805488 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b5dd3dd1-3d68-49bb-a0d9-896d6fdc9255 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:39.812801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b5dd3dd1-3d68-49bb-a0d9-896d6fdc9255 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:39.813243 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b5dd3dd1-3d68-49bb-a0d9-896d6fdc9255 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:39.814008 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b5dd3dd1-3d68-49bb-a0d9-896d6fdc9255 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:39.814464 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b5dd3dd1-3d68-49bb-a0d9-896d6fdc9255 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:40.030388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b5dd3dd1-3d68-49bb-a0d9-896d6fdc9255 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:40.037696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b5dd3dd1-3d68-49bb-a0d9-896d6fdc9255 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.237019 Jun 16 11:59:40.038265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 255/525] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:39 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:40.242600 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-2032914b-8224-43c8-9bf2-ce7468cf7d09 req-a0701e37-6679-46fa-87bd-62391871c59d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce66b98-0e9e-40cf-a971-f00cf0132326", "tag": "d06f37d1-57c7-48f9-a3c7-1e29dd3fe530"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:40.252427 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-2032914b-8224-43c8-9bf2-ce7468cf7d09 req-a0701e37-6679-46fa-87bd-62391871c59d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:40.255118 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-2032914b-8224-43c8-9bf2-ce7468cf7d09 req-a0701e37-6679-46fa-87bd-62391871c59d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:40.266942 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-2032914b-8224-43c8-9bf2-ce7468cf7d09 req-a0701e37-6679-46fa-87bd-62391871c59d service nova] Creating event network-changed:d06f37d1-57c7-48f9-a3c7-1e29dd3fe530 for instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 on hv-cinder-84614 Jun 16 11:59:40.272149 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-2032914b-8224-43c8-9bf2-ce7468cf7d09 req-a0701e37-6679-46fa-87bd-62391871c59d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033179 Jun 16 11:59:40.272838 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 271/526] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:59:40.357495 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-77666424-61b9-4075-ba20-ab425257bbda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9465cb0d-5830-441c-a73a-1a6f899ef823"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:40.358615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-77666424-61b9-4075-ba20-ab425257bbda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:40.364686 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-77666424-61b9-4075-ba20-ab425257bbda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:40.365124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-77666424-61b9-4075-ba20-ab425257bbda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:40.365873 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-77666424-61b9-4075-ba20-ab425257bbda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:40.366295 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-77666424-61b9-4075-ba20-ab425257bbda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:40.437048 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=100 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:40.573233 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7654768c-be88-4af6-b8cd-57133e2ec00d tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:40.574102 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7654768c-be88-4af6-b8cd-57133e2ec00d tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:40.580936 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7654768c-be88-4af6-b8cd-57133e2ec00d tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:40.581397 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7654768c-be88-4af6-b8cd-57133e2ec00d tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:40.582445 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7654768c-be88-4af6-b8cd-57133e2ec00d tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:40.582871 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7654768c-be88-4af6-b8cd-57133e2ec00d tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:40.744820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7654768c-be88-4af6-b8cd-57133e2ec00d tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:40.753728 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7654768c-be88-4af6-b8cd-57133e2ec00d tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.186095 Jun 16 11:59:40.754305 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 272/527] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:40 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:41.003504 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:41.023758 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=6 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:41.054494 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-be78a785-bc29-4a89-b2ed-cba908bf9445 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:41.055100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-be78a785-bc29-4a89-b2ed-cba908bf9445 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:41.061742 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-be78a785-bc29-4a89-b2ed-cba908bf9445 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:41.061909 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-77666424-61b9-4075-ba20-ab425257bbda tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708850 Jun 16 11:59:41.062189 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-be78a785-bc29-4a89-b2ed-cba908bf9445 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:41.062494 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 256/528] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 11:59:40 2022] POST /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 11:59:41.062994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-be78a785-bc29-4a89-b2ed-cba908bf9445 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:41.063431 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-be78a785-bc29-4a89-b2ed-cba908bf9445 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:41.190945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-be78a785-bc29-4a89-b2ed-cba908bf9445 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:41.198892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-be78a785-bc29-4a89-b2ed-cba908bf9445 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.148257 Jun 16 11:59:41.199440 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 273/529] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:41 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:41.772062 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f176f830-1648-4e13-b9c9-3e74edee78b4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:41.772861 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f176f830-1648-4e13-b9c9-3e74edee78b4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:41.781527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f176f830-1648-4e13-b9c9-3e74edee78b4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:41.782100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f176f830-1648-4e13-b9c9-3e74edee78b4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:41.782873 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f176f830-1648-4e13-b9c9-3e74edee78b4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:41.783373 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f176f830-1648-4e13-b9c9-3e74edee78b4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:42.128819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f176f830-1648-4e13-b9c9-3e74edee78b4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:42.136800 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f176f830-1648-4e13-b9c9-3e74edee78b4 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.369451 Jun 16 11:59:42.137365 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 257/530] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:41 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:42.214807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-770fca81-c0fd-4fef-88b3-3c88b6090cfb tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:42.215434 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-770fca81-c0fd-4fef-88b3-3c88b6090cfb tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:42.222794 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-770fca81-c0fd-4fef-88b3-3c88b6090cfb tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:42.223233 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-770fca81-c0fd-4fef-88b3-3c88b6090cfb tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:42.224026 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-770fca81-c0fd-4fef-88b3-3c88b6090cfb tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:42.224460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-770fca81-c0fd-4fef-88b3-3c88b6090cfb tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:42.358663 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-770fca81-c0fd-4fef-88b3-3c88b6090cfb tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:42.365975 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-770fca81-c0fd-4fef-88b3-3c88b6090cfb tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.155592 Jun 16 11:59:42.366530 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 274/531] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:42 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:42.643684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-73df5374-5e98-4a9b-b30a-9fb92bd36f38 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:42.643684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-73df5374-5e98-4a9b-b30a-9fb92bd36f38 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:42.649511 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-73df5374-5e98-4a9b-b30a-9fb92bd36f38 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:42.669601 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-73df5374-5e98-4a9b-b30a-9fb92bd36f38 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:42.669601 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-73df5374-5e98-4a9b-b30a-9fb92bd36f38 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:42.669601 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-73df5374-5e98-4a9b-b30a-9fb92bd36f38 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:42.772343 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-73df5374-5e98-4a9b-b30a-9fb92bd36f38 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lazy-loading 'services' on Instance uuid bd786b9e-48e7-4695-8549-aeabb6511e72 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:59:42.939975 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-e95e5a5f-6e2d-4686-86fe-1842e2f64e95 req-19d32ea6-7dea-4faf-bfdf-c111e2d26150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63bc42ae-4582-4510-b6ff-fdca91e3c01e", "name": "network-vif-plugged", "status": "completed", "tag": "1dea0f7a-7cea-4e33-9f1f-783b915bb580"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:42.951573 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-e95e5a5f-6e2d-4686-86fe-1842e2f64e95 req-19d32ea6-7dea-4faf-bfdf-c111e2d26150 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:42.952065 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-e95e5a5f-6e2d-4686-86fe-1842e2f64e95 req-19d32ea6-7dea-4faf-bfdf-c111e2d26150 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:42.966244 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-e95e5a5f-6e2d-4686-86fe-1842e2f64e95 req-19d32ea6-7dea-4faf-bfdf-c111e2d26150 service nova] Creating event network-vif-plugged:1dea0f7a-7cea-4e33-9f1f-783b915bb580 for instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e on hv-cinder-84614 Jun 16 11:59:42.971267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-e95e5a5f-6e2d-4686-86fe-1842e2f64e95 req-19d32ea6-7dea-4faf-bfdf-c111e2d26150 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035367 Jun 16 11:59:42.974878 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 275/532] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:59:43.028943 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-73df5374-5e98-4a9b-b30a-9fb92bd36f38 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/os-volume_attachments/8891e5cc-0e9c-4025-bcb5-9f4ac71e5ebe" status: 202 len: 0 microversion: 2.1 time: 0.390665 Jun 16 11:59:43.029688 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 258/533] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 11:59:42 2022] DELETE /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/os-volume_attachments/8891e5cc-0e9c-4025-bcb5-9f4ac71e5ebe => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 11:59:43.154519 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6517df90-f33b-41a8-af90-3fbbda0f43ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:43.155964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6517df90-f33b-41a8-af90-3fbbda0f43ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:43.162849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6517df90-f33b-41a8-af90-3fbbda0f43ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:43.163290 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6517df90-f33b-41a8-af90-3fbbda0f43ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:43.164112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6517df90-f33b-41a8-af90-3fbbda0f43ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:43.164544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6517df90-f33b-41a8-af90-3fbbda0f43ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:43.318942 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6517df90-f33b-41a8-af90-3fbbda0f43ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:43.327810 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6517df90-f33b-41a8-af90-3fbbda0f43ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.177760 Jun 16 11:59:43.328399 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 276/534] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:43 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:43.382918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6808ea92-9b5d-458d-8d25-5af126f15fc2 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:43.383641 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6808ea92-9b5d-458d-8d25-5af126f15fc2 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:43.390652 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6808ea92-9b5d-458d-8d25-5af126f15fc2 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:43.391094 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6808ea92-9b5d-458d-8d25-5af126f15fc2 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:43.391843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6808ea92-9b5d-458d-8d25-5af126f15fc2 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:43.392315 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6808ea92-9b5d-458d-8d25-5af126f15fc2 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:43.521043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6808ea92-9b5d-458d-8d25-5af126f15fc2 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:43.528372 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6808ea92-9b5d-458d-8d25-5af126f15fc2 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.149672 Jun 16 11:59:43.529019 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 259/535] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:43 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:44.344455 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3c6af8e2-16b8-4323-bcda-310eceeba78f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:44.345064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3c6af8e2-16b8-4323-bcda-310eceeba78f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:44.351451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3c6af8e2-16b8-4323-bcda-310eceeba78f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:44.351912 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3c6af8e2-16b8-4323-bcda-310eceeba78f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:44.352674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3c6af8e2-16b8-4323-bcda-310eceeba78f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:44.353103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3c6af8e2-16b8-4323-bcda-310eceeba78f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:44.482007 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3c6af8e2-16b8-4323-bcda-310eceeba78f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:44.489339 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3c6af8e2-16b8-4323-bcda-310eceeba78f tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1313 microversion: 2.1 time: 0.148947 Jun 16 11:59:44.505191 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 277/536] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:44 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:44.545248 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b8368a33-03e6-4854-b60d-da436c6c8fe8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:44.546221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b8368a33-03e6-4854-b60d-da436c6c8fe8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:44.552317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8368a33-03e6-4854-b60d-da436c6c8fe8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:44.552754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8368a33-03e6-4854-b60d-da436c6c8fe8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:44.553502 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8368a33-03e6-4854-b60d-da436c6c8fe8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:44.553924 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8368a33-03e6-4854-b60d-da436c6c8fe8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:44.683250 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b8368a33-03e6-4854-b60d-da436c6c8fe8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:44.690762 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b8368a33-03e6-4854-b60d-da436c6c8fe8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.149724 Jun 16 11:59:44.691425 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 260/537] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:44 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:45.519849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-207907fa-0cd1-4107-b208-f6a82b460cf5 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:45.520485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-207907fa-0cd1-4107-b208-f6a82b460cf5 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:45.527098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-207907fa-0cd1-4107-b208-f6a82b460cf5 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:45.527537 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-207907fa-0cd1-4107-b208-f6a82b460cf5 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:45.528334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-207907fa-0cd1-4107-b208-f6a82b460cf5 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:45.528788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-207907fa-0cd1-4107-b208-f6a82b460cf5 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:45.655074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-207907fa-0cd1-4107-b208-f6a82b460cf5 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:45.662387 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-207907fa-0cd1-4107-b208-f6a82b460cf5 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1496 microversion: 2.1 time: 0.146323 Jun 16 11:59:45.662977 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 278/538] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:45 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1496 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:45.707175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3e72de61-e609-4e27-9d02-d3d3008ac3b9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:45.707638 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3e72de61-e609-4e27-9d02-d3d3008ac3b9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:45.713849 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e72de61-e609-4e27-9d02-d3d3008ac3b9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:45.714287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e72de61-e609-4e27-9d02-d3d3008ac3b9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:45.715041 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e72de61-e609-4e27-9d02-d3d3008ac3b9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:45.715476 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e72de61-e609-4e27-9d02-d3d3008ac3b9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:45.845636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3e72de61-e609-4e27-9d02-d3d3008ac3b9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:45.853036 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3e72de61-e609-4e27-9d02-d3d3008ac3b9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.149698 Jun 16 11:59:45.854099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 261/539] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:45 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:46.382880 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-42c1d4d3-2868-47db-a96d-46d0e98d35f0 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:46.383367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-42c1d4d3-2868-47db-a96d-46d0e98d35f0 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:46.386086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:46.391051 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-42c1d4d3-2868-47db-a96d-46d0e98d35f0 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:46.391549 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-42c1d4d3-2868-47db-a96d-46d0e98d35f0 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:46.392410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-42c1d4d3-2868-47db-a96d-46d0e98d35f0 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:46.392840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-42c1d4d3-2868-47db-a96d-46d0e98d35f0 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:46.418540 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-42c1d4d3-2868-47db-a96d-46d0e98d35f0 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 11:59:46.582929 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=10 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:46.716240 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-42c1d4d3-2868-47db-a96d-46d0e98d35f0 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "DELETE /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 204 len: 0 microversion: 2.1 time: 0.336918 Jun 16 11:59:46.716832 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 279/540] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 11:59:46 2022] DELETE /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 11:59:46.725497 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6515af09-0d0c-4e6f-b71b-be1ed19aba4c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:46.737606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6515af09-0d0c-4e6f-b71b-be1ed19aba4c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:46.737606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6515af09-0d0c-4e6f-b71b-be1ed19aba4c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:46.737606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6515af09-0d0c-4e6f-b71b-be1ed19aba4c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:46.737606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6515af09-0d0c-4e6f-b71b-be1ed19aba4c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:46.737979 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6515af09-0d0c-4e6f-b71b-be1ed19aba4c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:46.865003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6515af09-0d0c-4e6f-b71b-be1ed19aba4c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:46.871197 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-89d36387-dbdc-4514-b1fe-07a4a9313549 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:46.871990 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-89d36387-dbdc-4514-b1fe-07a4a9313549 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:46.873261 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6515af09-0d0c-4e6f-b71b-be1ed19aba4c tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1502 microversion: 2.1 time: 0.151787 Jun 16 11:59:46.873838 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 262/541] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:46 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:46.878200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-89d36387-dbdc-4514-b1fe-07a4a9313549 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:46.882724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-89d36387-dbdc-4514-b1fe-07a4a9313549 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:46.882724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-89d36387-dbdc-4514-b1fe-07a4a9313549 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:46.882724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-89d36387-dbdc-4514-b1fe-07a4a9313549 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:47.009190 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-37333ce3-9f3d-4a94-9690-79d5e6eb82e9 req-378c0464-830e-4180-8787-8ad6a738b03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce66b98-0e9e-40cf-a971-f00cf0132326", "name": "network-vif-plugged", "status": "completed", "tag": "d06f37d1-57c7-48f9-a3c7-1e29dd3fe530"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:47.014159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-89d36387-dbdc-4514-b1fe-07a4a9313549 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:47.018521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-37333ce3-9f3d-4a94-9690-79d5e6eb82e9 req-378c0464-830e-4180-8787-8ad6a738b03a service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:47.018955 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-37333ce3-9f3d-4a94-9690-79d5e6eb82e9 req-378c0464-830e-4180-8787-8ad6a738b03a service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:47.021709 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-89d36387-dbdc-4514-b1fe-07a4a9313549 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.155386 Jun 16 11:59:47.022307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 280/542] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:46 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:47.030595 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-37333ce3-9f3d-4a94-9690-79d5e6eb82e9 req-378c0464-830e-4180-8787-8ad6a738b03a service nova] Creating event network-vif-plugged:d06f37d1-57c7-48f9-a3c7-1e29dd3fe530 for instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 on hv-cinder-84614 Jun 16 11:59:47.035559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-37333ce3-9f3d-4a94-9690-79d5e6eb82e9 req-378c0464-830e-4180-8787-8ad6a738b03a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030268 Jun 16 11:59:47.039070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 263/543] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:59:47.890352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4cc6c093-ad2c-4c1c-b30f-2abf180fb122 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:47.890984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4cc6c093-ad2c-4c1c-b30f-2abf180fb122 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:47.897750 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-ad2c-4c1c-b30f-2abf180fb122 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:47.898201 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-ad2c-4c1c-b30f-2abf180fb122 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:47.898966 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-ad2c-4c1c-b30f-2abf180fb122 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:47.899399 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-ad2c-4c1c-b30f-2abf180fb122 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:48.025699 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4cc6c093-ad2c-4c1c-b30f-2abf180fb122 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:48.033777 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4cc6c093-ad2c-4c1c-b30f-2abf180fb122 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1502 microversion: 2.1 time: 0.147463 Jun 16 11:59:48.034344 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 281/544] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:47 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:48.038959 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b1bb1562-d77b-4578-bed2-40d7cf8d9506 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:48.039659 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b1bb1562-d77b-4578-bed2-40d7cf8d9506 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:48.047053 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1bb1562-d77b-4578-bed2-40d7cf8d9506 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:48.047498 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1bb1562-d77b-4578-bed2-40d7cf8d9506 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:48.048357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1bb1562-d77b-4578-bed2-40d7cf8d9506 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:48.048795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1bb1562-d77b-4578-bed2-40d7cf8d9506 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:48.180533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b1bb1562-d77b-4578-bed2-40d7cf8d9506 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:48.187895 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b1bb1562-d77b-4578-bed2-40d7cf8d9506 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.153203 Jun 16 11:59:48.188450 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 264/545] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:48 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:49.050741 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7eb9f708-c72e-414b-a5fd-8935917e6851 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:49.051446 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7eb9f708-c72e-414b-a5fd-8935917e6851 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:49.058294 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7eb9f708-c72e-414b-a5fd-8935917e6851 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:49.058693 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7eb9f708-c72e-414b-a5fd-8935917e6851 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:49.059480 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7eb9f708-c72e-414b-a5fd-8935917e6851 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:49.059940 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7eb9f708-c72e-414b-a5fd-8935917e6851 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:49.188373 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7eb9f708-c72e-414b-a5fd-8935917e6851 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:49.196055 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7eb9f708-c72e-414b-a5fd-8935917e6851 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1502 microversion: 2.1 time: 0.149377 Jun 16 11:59:49.196623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 282/546] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:49 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:49.204392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8c93b532-523f-468c-9690-7f3b671628c1 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:49.205030 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8c93b532-523f-468c-9690-7f3b671628c1 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:49.211444 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8c93b532-523f-468c-9690-7f3b671628c1 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:49.211916 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8c93b532-523f-468c-9690-7f3b671628c1 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:49.212677 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8c93b532-523f-468c-9690-7f3b671628c1 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:49.213108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8c93b532-523f-468c-9690-7f3b671628c1 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:49.350863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-c8d2cb80-7637-4210-8faa-813353012975 req-a3d7417b-d37c-430b-aa99-82b3f1e90d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63bc42ae-4582-4510-b6ff-fdca91e3c01e", "name": "network-vif-deleted", "tag": "1dea0f7a-7cea-4e33-9f1f-783b915bb580"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:49.359522 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-c8d2cb80-7637-4210-8faa-813353012975 req-a3d7417b-d37c-430b-aa99-82b3f1e90d05 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:49.359989 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-c8d2cb80-7637-4210-8faa-813353012975 req-a3d7417b-d37c-430b-aa99-82b3f1e90d05 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:49.371350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-c8d2cb80-7637-4210-8faa-813353012975 req-a3d7417b-d37c-430b-aa99-82b3f1e90d05 service nova] Creating event network-vif-deleted:1dea0f7a-7cea-4e33-9f1f-783b915bb580 for instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e on hv-cinder-84614 Jun 16 11:59:49.376185 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-c8d2cb80-7637-4210-8faa-813353012975 req-a3d7417b-d37c-430b-aa99-82b3f1e90d05 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028918 Jun 16 11:59:49.376936 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 283/547] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 11:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 11:59:49.409411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8c93b532-523f-468c-9690-7f3b671628c1 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:49.426763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8c93b532-523f-468c-9690-7f3b671628c1 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.226070 Jun 16 11:59:49.427340 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 265/548] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:49 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:50.214347 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:50.215038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:50.221469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:50.221912 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:50.222670 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:50.223101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:50.253328 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:50.253773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:50.254211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lazy-loading 'fault' on Instance uuid 63bc42ae-4582-4510-b6ff-fdca91e3c01e {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:59:50.299021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:50.306509 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b10229bc-cef5-433c-91c0-fba51340f0ec tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1303 microversion: 2.1 time: 0.097396 Jun 16 11:59:50.307065 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 284/549] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:50 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:50.445871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-68c5bfea-3034-43ee-bd0c-02c8f9cb42aa tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:50.446560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-68c5bfea-3034-43ee-bd0c-02c8f9cb42aa tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:50.453656 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-68c5bfea-3034-43ee-bd0c-02c8f9cb42aa tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:50.454191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-68c5bfea-3034-43ee-bd0c-02c8f9cb42aa tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:50.455100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-68c5bfea-3034-43ee-bd0c-02c8f9cb42aa tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:50.455760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-68c5bfea-3034-43ee-bd0c-02c8f9cb42aa tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:50.591183 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-68c5bfea-3034-43ee-bd0c-02c8f9cb42aa tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:50.599027 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-68c5bfea-3034-43ee-bd0c-02c8f9cb42aa tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1318 microversion: 2.1 time: 0.157594 Jun 16 11:59:50.599599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 266/550] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:50 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:50.691706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c3b8609c-6c64-40a1-ab4c-df2fd211275b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:50.692666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c3b8609c-6c64-40a1-ab4c-df2fd211275b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:50.699351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3b8609c-6c64-40a1-ab4c-df2fd211275b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:50.699794 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3b8609c-6c64-40a1-ab4c-df2fd211275b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:50.700577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3b8609c-6c64-40a1-ab4c-df2fd211275b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:50.701006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c3b8609c-6c64-40a1-ab4c-df2fd211275b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:50.722986 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-c3b8609c-6c64-40a1-ab4c-df2fd211275b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'flavor' on Instance uuid 5c202b5a-d86c-445a-9119-9b0893b15c1f {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:59:50.797519 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:51.063072 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c3b8609c-6c64-40a1-ab4c-df2fd211275b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/action" status: 200 len: 32 microversion: 2.1 time: 0.375139 Jun 16 11:59:51.063605 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 285/551] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:59:50 2022] POST /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 11:59:51.072543 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d9146463-35f2-42dd-814f-5d5b4c5f43ef tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:51.073681 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d9146463-35f2-42dd-814f-5d5b4c5f43ef tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:51.079722 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d9146463-35f2-42dd-814f-5d5b4c5f43ef tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:51.080195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d9146463-35f2-42dd-814f-5d5b4c5f43ef tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:51.080951 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d9146463-35f2-42dd-814f-5d5b4c5f43ef tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:51.081380 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d9146463-35f2-42dd-814f-5d5b4c5f43ef tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:51.208261 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d9146463-35f2-42dd-814f-5d5b4c5f43ef tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:51.216957 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d9146463-35f2-42dd-814f-5d5b4c5f43ef tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.148209 Jun 16 11:59:51.217530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 267/552] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:51 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:51.324193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:51.325073 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:51.331420 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:51.331886 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:51.332660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:51.333093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:51.365809 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:51.366256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:51.366706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lazy-loading 'fault' on Instance uuid 63bc42ae-4582-4510-b6ff-fdca91e3c01e {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 11:59:51.408962 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9082354c3ab249f885e129b86799e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8858f51824444782c874f15da7b16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:51.416870 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1776c90e-3282-45dc-beb0-4d12971c1677 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 200 len: 1303 microversion: 2.1 time: 0.097955 Jun 16 11:59:51.421851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 286/553] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:51 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:51.616019 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-18b4a7eb-4271-4843-8042-cd5bed85a163 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:51.616651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-18b4a7eb-4271-4843-8042-cd5bed85a163 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:51.623885 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-18b4a7eb-4271-4843-8042-cd5bed85a163 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:51.624395 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-18b4a7eb-4271-4843-8042-cd5bed85a163 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:51.625353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-18b4a7eb-4271-4843-8042-cd5bed85a163 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:51.625812 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-18b4a7eb-4271-4843-8042-cd5bed85a163 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:51.823480 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-18b4a7eb-4271-4843-8042-cd5bed85a163 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:51.831460 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-18b4a7eb-4271-4843-8042-cd5bed85a163 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1507 microversion: 2.1 time: 0.219360 Jun 16 11:59:51.832372 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 268/554] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:51 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 11:59:52.234856 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e6592a5b-3c40-419e-9eed-5fca333e39c5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:52.236035 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e6592a5b-3c40-419e-9eed-5fca333e39c5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:52.241856 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6592a5b-3c40-419e-9eed-5fca333e39c5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:52.242292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6592a5b-3c40-419e-9eed-5fca333e39c5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:52.243121 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6592a5b-3c40-419e-9eed-5fca333e39c5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:52.243558 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6592a5b-3c40-419e-9eed-5fca333e39c5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:52.374594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e6592a5b-3c40-419e-9eed-5fca333e39c5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:52.382514 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e6592a5b-3c40-419e-9eed-5fca333e39c5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.151518 Jun 16 11:59:52.383064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 287/555] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:52 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:52.433406 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:52.434014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] [instance: 63bc42ae-4582-4510-b6ff-fdca91e3c01e] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:52.440028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:52.440474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:52.441226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:52.441654 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:52.454764 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] HTTP exception thrown: Instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e could not be found. Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Request method failure captured: Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e HTTP/1.1 Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxrzSvAYRzmly7cMUaLLLW0chvKH4rRUY3-uJMkKXjnN_Z9BK8PSt2utjKQnAbeUW9rI5srYN3mVh8UQ5fRJ_PpcDrtJk-ridTt8JnClsqmrr1Q00q_aVNYawLri8Y1ipBfK7jxEzI07ChJdtmLKpTW5JvBs_YgnjMhptCj4SoHn7Os Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 1c8858f51824444782c874f15da7b16b Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesActionsTest-1749508694 Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 11:59:52.456386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c8858f51824444782c874f15da7b16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c8858f51824444782c874f15da7b16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c8858f51824444782c874f15da7b16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c8858f51824444782c874f15da7b16b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesActionsTest-1749508694 Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 1c8858f51824444782c874f15da7b16b Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesActionsTest-1749508694 Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesActionsTest-1749508694-project Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 9082354c3ab249f885e129b86799e508 Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesActionsTest-1749508694-project Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e could not be found. Jun 16 11:59:52.457922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '63bc42ae-4582-4510-b6ff-fdca91e3c01e'} Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e could not be found. Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 11:59:52.458787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e could not be found. Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e could not be found. Jun 16 11:59:52.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 11:59:52.461543 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] Returning 404 to user: Instance 63bc42ae-4582-4510-b6ff-fdca91e3c01e could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 11:59:52.461543 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-09e6424c-62db-46ff-b492-7a0b732f7945 tempest-VolumesActionsTest-1749508694 tempest-VolumesActionsTest-1749508694-project] 10.222.0.40 "GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e" status: 404 len: 111 microversion: 2.1 time: 0.028245 Jun 16 11:59:52.461543 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 269/556] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:52 2022] GET /compute/v2.1/servers/63bc42ae-4582-4510-b6ff-fdca91e3c01e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 11:59:52.590964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-73bcaf88-e2b1-4fff-b9c8-301e9b98f6c9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 11:59:52.598218 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-73bcaf88-e2b1-4fff-b9c8-301e9b98f6c9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:52.598651 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-73bcaf88-e2b1-4fff-b9c8-301e9b98f6c9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:52.627905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-73bcaf88-e2b1-4fff-b9c8-301e9b98f6c9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Going to try to stop instance {{(pid=125054) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 11:59:52.867723 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-73bcaf88-e2b1-4fff-b9c8-301e9b98f6c9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/action" status: 202 len: 0 microversion: 2.1 time: 0.281295 Jun 16 11:59:52.868365 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 288/557] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 11:59:52 2022] POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 11:59:52.877250 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-303e0bfa-a76e-4e75-9f35-ed6919ddcf7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:52.877867 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-303e0bfa-a76e-4e75-9f35-ed6919ddcf7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:52.884358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-303e0bfa-a76e-4e75-9f35-ed6919ddcf7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:52.884834 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-303e0bfa-a76e-4e75-9f35-ed6919ddcf7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:52.885607 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-303e0bfa-a76e-4e75-9f35-ed6919ddcf7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:52.886039 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-303e0bfa-a76e-4e75-9f35-ed6919ddcf7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:53.030441 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-303e0bfa-a76e-4e75-9f35-ed6919ddcf7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:53.037945 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-303e0bfa-a76e-4e75-9f35-ed6919ddcf7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.164700 Jun 16 11:59:53.038495 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 270/558] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:52 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:53.400465 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-29ddb677-ad9d-4d01-ab97-db86b7a550e1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:53.404511 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-29ddb677-ad9d-4d01-ab97-db86b7a550e1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:53.407212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-29ddb677-ad9d-4d01-ab97-db86b7a550e1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:53.407659 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-29ddb677-ad9d-4d01-ab97-db86b7a550e1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:53.408442 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-29ddb677-ad9d-4d01-ab97-db86b7a550e1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:53.408871 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-29ddb677-ad9d-4d01-ab97-db86b7a550e1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:53.544317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-29ddb677-ad9d-4d01-ab97-db86b7a550e1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:53.552870 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-29ddb677-ad9d-4d01-ab97-db86b7a550e1 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.157101 Jun 16 11:59:53.553826 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 289/559] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:53 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:54.055150 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f702c554-9634-47a0-aae8-6dc0fbd35591 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:54.055753 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f702c554-9634-47a0-aae8-6dc0fbd35591 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:54.062726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f702c554-9634-47a0-aae8-6dc0fbd35591 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:54.063162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f702c554-9634-47a0-aae8-6dc0fbd35591 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:54.063949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f702c554-9634-47a0-aae8-6dc0fbd35591 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:54.064377 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f702c554-9634-47a0-aae8-6dc0fbd35591 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:54.191480 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f702c554-9634-47a0-aae8-6dc0fbd35591 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:54.199578 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f702c554-9634-47a0-aae8-6dc0fbd35591 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.148174 Jun 16 11:59:54.200185 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 271/560] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:54 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:54.570434 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f64915dc-2444-4b52-a8d4-45e07d8bcda4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:54.571041 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f64915dc-2444-4b52-a8d4-45e07d8bcda4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:54.577839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f64915dc-2444-4b52-a8d4-45e07d8bcda4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:54.578284 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f64915dc-2444-4b52-a8d4-45e07d8bcda4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:54.579043 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f64915dc-2444-4b52-a8d4-45e07d8bcda4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:54.579481 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f64915dc-2444-4b52-a8d4-45e07d8bcda4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:54.708538 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f64915dc-2444-4b52-a8d4-45e07d8bcda4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:54.716947 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f64915dc-2444-4b52-a8d4-45e07d8bcda4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.150309 Jun 16 11:59:54.717510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 290/561] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:54 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:55.216878 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d090690b-13b4-48a8-8cc6-a8743f9b1ea5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:55.217496 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d090690b-13b4-48a8-8cc6-a8743f9b1ea5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:55.224413 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d090690b-13b4-48a8-8cc6-a8743f9b1ea5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:55.224860 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d090690b-13b4-48a8-8cc6-a8743f9b1ea5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:55.225630 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d090690b-13b4-48a8-8cc6-a8743f9b1ea5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:55.226064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d090690b-13b4-48a8-8cc6-a8743f9b1ea5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:55.358701 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d090690b-13b4-48a8-8cc6-a8743f9b1ea5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:55.361034 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:55.366963 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d090690b-13b4-48a8-8cc6-a8743f9b1ea5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.154682 Jun 16 11:59:55.367537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 272/562] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:55 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:55.734030 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-529512b4-f676-4098-b13f-b6ebf0e6e5d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:55.734637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-529512b4-f676-4098-b13f-b6ebf0e6e5d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:55.741169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-529512b4-f676-4098-b13f-b6ebf0e6e5d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:55.741588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-529512b4-f676-4098-b13f-b6ebf0e6e5d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:55.742845 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-529512b4-f676-4098-b13f-b6ebf0e6e5d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:55.742845 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-529512b4-f676-4098-b13f-b6ebf0e6e5d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:55.872705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-529512b4-f676-4098-b13f-b6ebf0e6e5d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:55.880527 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-529512b4-f676-4098-b13f-b6ebf0e6e5d5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.150322 Jun 16 11:59:55.881079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 291/563] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:55 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:56.383950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3bf6ed6e-57ea-41a9-a686-2c54e5fa32bc tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:56.384554 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3bf6ed6e-57ea-41a9-a686-2c54e5fa32bc tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:56.392104 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3bf6ed6e-57ea-41a9-a686-2c54e5fa32bc tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:56.392538 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3bf6ed6e-57ea-41a9-a686-2c54e5fa32bc tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:56.393293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3bf6ed6e-57ea-41a9-a686-2c54e5fa32bc tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:56.393714 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3bf6ed6e-57ea-41a9-a686-2c54e5fa32bc tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:56.518675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3bf6ed6e-57ea-41a9-a686-2c54e5fa32bc tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:56.526684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3bf6ed6e-57ea-41a9-a686-2c54e5fa32bc tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.145964 Jun 16 11:59:56.527253 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 273/564] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:56 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:56.897316 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a7ec535f-cd32-485a-83e2-e69909c6cc58 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:56.897916 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a7ec535f-cd32-485a-83e2-e69909c6cc58 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:56.904649 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a7ec535f-cd32-485a-83e2-e69909c6cc58 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:56.905085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a7ec535f-cd32-485a-83e2-e69909c6cc58 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:56.905856 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a7ec535f-cd32-485a-83e2-e69909c6cc58 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:56.906286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a7ec535f-cd32-485a-83e2-e69909c6cc58 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:57.035785 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a7ec535f-cd32-485a-83e2-e69909c6cc58 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:57.043557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a7ec535f-cd32-485a-83e2-e69909c6cc58 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.150056 Jun 16 11:59:57.044155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 292/565] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:56 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:57.543692 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4942d157-3539-4b2f-b0de-18010c5a1593 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:57.544321 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4942d157-3539-4b2f-b0de-18010c5a1593 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:57.550800 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4942d157-3539-4b2f-b0de-18010c5a1593 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:57.551234 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4942d157-3539-4b2f-b0de-18010c5a1593 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:57.552010 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4942d157-3539-4b2f-b0de-18010c5a1593 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:57.552563 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4942d157-3539-4b2f-b0de-18010c5a1593 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:57.686279 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4942d157-3539-4b2f-b0de-18010c5a1593 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:57.693933 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4942d157-3539-4b2f-b0de-18010c5a1593 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.153994 Jun 16 11:59:57.694474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 274/566] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:57 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:58.060925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cee6e94a-dbe1-49a7-98e0-ffb25c9db557 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:58.061461 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cee6e94a-dbe1-49a7-98e0-ffb25c9db557 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:58.063956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:58.068650 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cee6e94a-dbe1-49a7-98e0-ffb25c9db557 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:58.069101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cee6e94a-dbe1-49a7-98e0-ffb25c9db557 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:58.069865 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cee6e94a-dbe1-49a7-98e0-ffb25c9db557 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:58.070300 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cee6e94a-dbe1-49a7-98e0-ffb25c9db557 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:58.206085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cee6e94a-dbe1-49a7-98e0-ffb25c9db557 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:58.215591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cee6e94a-dbe1-49a7-98e0-ffb25c9db557 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.159190 Jun 16 11:59:58.216251 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 293/567] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:58 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:58.717421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-637a0e97-c907-4127-9b03-b01987858d75 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:58.718180 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-637a0e97-c907-4127-9b03-b01987858d75 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:58.725572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-637a0e97-c907-4127-9b03-b01987858d75 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:58.726011 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-637a0e97-c907-4127-9b03-b01987858d75 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:58.726770 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-637a0e97-c907-4127-9b03-b01987858d75 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:58.727193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-637a0e97-c907-4127-9b03-b01987858d75 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:58.870078 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-637a0e97-c907-4127-9b03-b01987858d75 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:58.879381 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-637a0e97-c907-4127-9b03-b01987858d75 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.166772 Jun 16 11:59:58.880763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 275/568] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:58 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:59.232656 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d0acbf90-188d-400c-b327-41142cc66a7d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:59.233262 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d0acbf90-188d-400c-b327-41142cc66a7d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:59.240411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d0acbf90-188d-400c-b327-41142cc66a7d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:59.240870 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d0acbf90-188d-400c-b327-41142cc66a7d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:59.241671 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d0acbf90-188d-400c-b327-41142cc66a7d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:59.242102 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d0acbf90-188d-400c-b327-41142cc66a7d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:59.383822 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d0acbf90-188d-400c-b327-41142cc66a7d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 11:59:59.392253 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d0acbf90-188d-400c-b327-41142cc66a7d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.163930 Jun 16 11:59:59.392826 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 294/569] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:59 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 11:59:59.898131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-adf45b6d-80ed-4c46-81f7-338afb56b3f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 11:59:59.899331 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-adf45b6d-80ed-4c46-81f7-338afb56b3f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 11:59:59.906197 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-adf45b6d-80ed-4c46-81f7-338afb56b3f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:59.906743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-adf45b6d-80ed-4c46-81f7-338afb56b3f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 11:59:59.907571 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-adf45b6d-80ed-4c46-81f7-338afb56b3f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 11:59:59.908171 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-adf45b6d-80ed-4c46-81f7-338afb56b3f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:00.047550 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-adf45b6d-80ed-4c46-81f7-338afb56b3f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:00.056385 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-adf45b6d-80ed-4c46-81f7-338afb56b3f3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.161851 Jun 16 12:00:00.057801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 276/570] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 11:59:59 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:00.408581 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-61cdc9b1-700d-482c-b2c7-c410097cf1d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:00.409219 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-61cdc9b1-700d-482c-b2c7-c410097cf1d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:00.416701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61cdc9b1-700d-482c-b2c7-c410097cf1d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:00.417224 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61cdc9b1-700d-482c-b2c7-c410097cf1d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:00.418056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61cdc9b1-700d-482c-b2c7-c410097cf1d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:00.418495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61cdc9b1-700d-482c-b2c7-c410097cf1d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:00.551037 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-61cdc9b1-700d-482c-b2c7-c410097cf1d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:00.559806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-61cdc9b1-700d-482c-b2c7-c410097cf1d9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.155171 Jun 16 12:00:00.560420 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 295/571] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:00 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:01.074385 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-45d463a5-5905-4297-b724-dad7947a5c30 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:01.075005 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-45d463a5-5905-4297-b724-dad7947a5c30 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:01.081692 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-45d463a5-5905-4297-b724-dad7947a5c30 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:01.082145 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-45d463a5-5905-4297-b724-dad7947a5c30 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:01.082918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-45d463a5-5905-4297-b724-dad7947a5c30 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:01.083347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-45d463a5-5905-4297-b724-dad7947a5c30 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:01.221739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-45d463a5-5905-4297-b724-dad7947a5c30 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:01.230052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-45d463a5-5905-4297-b724-dad7947a5c30 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.159576 Jun 16 12:00:01.230617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 277/572] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:01 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:01.577501 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7f895dfb-2d06-4d6b-82ee-2996036db0a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:01.578019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7f895dfb-2d06-4d6b-82ee-2996036db0a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:01.589477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7f895dfb-2d06-4d6b-82ee-2996036db0a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:01.590454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7f895dfb-2d06-4d6b-82ee-2996036db0a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:01.596584 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7f895dfb-2d06-4d6b-82ee-2996036db0a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:01.597213 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7f895dfb-2d06-4d6b-82ee-2996036db0a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:01.737732 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7f895dfb-2d06-4d6b-82ee-2996036db0a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:01.745851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7f895dfb-2d06-4d6b-82ee-2996036db0a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.172229 Jun 16 12:00:01.746423 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 296/573] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:01 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:02.248108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-90a0228e-ecf6-43bc-9ead-de1ae34e297d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:02.249404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-90a0228e-ecf6-43bc-9ead-de1ae34e297d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:02.256587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90a0228e-ecf6-43bc-9ead-de1ae34e297d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:02.256988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90a0228e-ecf6-43bc-9ead-de1ae34e297d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:02.257938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90a0228e-ecf6-43bc-9ead-de1ae34e297d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:02.258373 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-90a0228e-ecf6-43bc-9ead-de1ae34e297d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:02.405589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-90a0228e-ecf6-43bc-9ead-de1ae34e297d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:02.414663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-90a0228e-ecf6-43bc-9ead-de1ae34e297d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.170996 Jun 16 12:00:02.415243 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 278/574] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:02 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:02.762444 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cd1c12ad-67d9-406d-9330-378d937ad86b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:02.763133 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cd1c12ad-67d9-406d-9330-378d937ad86b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:02.770170 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd1c12ad-67d9-406d-9330-378d937ad86b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:02.770652 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd1c12ad-67d9-406d-9330-378d937ad86b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:02.771471 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd1c12ad-67d9-406d-9330-378d937ad86b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:02.771937 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd1c12ad-67d9-406d-9330-378d937ad86b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:02.914331 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cd1c12ad-67d9-406d-9330-378d937ad86b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:02.924370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cd1c12ad-67d9-406d-9330-378d937ad86b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.165629 Jun 16 12:00:02.924998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 297/575] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:02 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:03.433735 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e89a1cd7-62f7-41d7-92e4-b6710ce40fd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:03.434659 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e89a1cd7-62f7-41d7-92e4-b6710ce40fd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:03.442665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e89a1cd7-62f7-41d7-92e4-b6710ce40fd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:03.443111 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e89a1cd7-62f7-41d7-92e4-b6710ce40fd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:03.443977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e89a1cd7-62f7-41d7-92e4-b6710ce40fd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:03.444736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e89a1cd7-62f7-41d7-92e4-b6710ce40fd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:03.600221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e89a1cd7-62f7-41d7-92e4-b6710ce40fd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:03.609278 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e89a1cd7-62f7-41d7-92e4-b6710ce40fd8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.180460 Jun 16 12:00:03.610260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 279/576] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:03 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:03.941200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-817ac7de-a946-4df8-822d-2a3d3071d26d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:03.942543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-817ac7de-a946-4df8-822d-2a3d3071d26d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:03.949491 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-817ac7de-a946-4df8-822d-2a3d3071d26d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:03.949960 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-817ac7de-a946-4df8-822d-2a3d3071d26d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:03.950991 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-817ac7de-a946-4df8-822d-2a3d3071d26d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:03.951695 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-817ac7de-a946-4df8-822d-2a3d3071d26d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:04.097129 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-817ac7de-a946-4df8-822d-2a3d3071d26d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:04.106772 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-817ac7de-a946-4df8-822d-2a3d3071d26d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.169599 Jun 16 12:00:04.107580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 298/577] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:03 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:04.627489 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6617e684-3b76-4764-befc-1e8e1c629d47 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:04.628070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6617e684-3b76-4764-befc-1e8e1c629d47 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:04.634074 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=70 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:04.636407 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6617e684-3b76-4764-befc-1e8e1c629d47 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:04.637082 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6617e684-3b76-4764-befc-1e8e1c629d47 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:04.638058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6617e684-3b76-4764-befc-1e8e1c629d47 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:04.638675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6617e684-3b76-4764-befc-1e8e1c629d47 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:04.868820 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6617e684-3b76-4764-befc-1e8e1c629d47 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:04.876743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6617e684-3b76-4764-befc-1e8e1c629d47 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.253989 Jun 16 12:00:04.877300 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 280/578] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:04 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:05.125389 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3501ae74-1176-4ebc-a356-a56dca172ec4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:05.127206 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3501ae74-1176-4ebc-a356-a56dca172ec4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:05.134262 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3501ae74-1176-4ebc-a356-a56dca172ec4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:05.134788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3501ae74-1176-4ebc-a356-a56dca172ec4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:05.136131 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3501ae74-1176-4ebc-a356-a56dca172ec4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:05.136774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3501ae74-1176-4ebc-a356-a56dca172ec4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:05.285726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3501ae74-1176-4ebc-a356-a56dca172ec4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:05.289419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:05.295757 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3501ae74-1176-4ebc-a356-a56dca172ec4 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.174473 Jun 16 12:00:05.296570 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 299/579] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:05 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:05.894534 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6df93104-6deb-4ad4-9b20-b40879ab1add tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:05.895249 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6df93104-6deb-4ad4-9b20-b40879ab1add tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:05.902368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6df93104-6deb-4ad4-9b20-b40879ab1add tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:05.902832 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6df93104-6deb-4ad4-9b20-b40879ab1add tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:05.903583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6df93104-6deb-4ad4-9b20-b40879ab1add tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:05.904051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6df93104-6deb-4ad4-9b20-b40879ab1add tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:06.044027 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6df93104-6deb-4ad4-9b20-b40879ab1add tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:06.051423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6df93104-6deb-4ad4-9b20-b40879ab1add tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.160930 Jun 16 12:00:06.052014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 281/580] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:05 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:06.313798 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c6cb27f0-7dbe-4c4c-858c-6020db394016 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:06.314414 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c6cb27f0-7dbe-4c4c-858c-6020db394016 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:06.321649 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c6cb27f0-7dbe-4c4c-858c-6020db394016 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:06.322012 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c6cb27f0-7dbe-4c4c-858c-6020db394016 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:06.322780 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c6cb27f0-7dbe-4c4c-858c-6020db394016 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:06.323245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c6cb27f0-7dbe-4c4c-858c-6020db394016 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:06.455960 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c6cb27f0-7dbe-4c4c-858c-6020db394016 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:06.464693 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c6cb27f0-7dbe-4c4c-858c-6020db394016 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.154204 Jun 16 12:00:06.465266 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 300/581] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:06 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:07.069362 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-eabf5f58-8cc9-4734-b698-15b4be20a4f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:07.080340 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-eabf5f58-8cc9-4734-b698-15b4be20a4f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:07.087642 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eabf5f58-8cc9-4734-b698-15b4be20a4f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:07.088118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eabf5f58-8cc9-4734-b698-15b4be20a4f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:07.089644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eabf5f58-8cc9-4734-b698-15b4be20a4f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:07.089997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eabf5f58-8cc9-4734-b698-15b4be20a4f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:07.227228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-eabf5f58-8cc9-4734-b698-15b4be20a4f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:07.235539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-eabf5f58-8cc9-4734-b698-15b4be20a4f7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.169870 Jun 16 12:00:07.236130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 282/582] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:07 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:07.481997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ef8a4b53-8fc3-4fde-b2b3-f1e8d0471022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:07.482938 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ef8a4b53-8fc3-4fde-b2b3-f1e8d0471022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:07.490737 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ef8a4b53-8fc3-4fde-b2b3-f1e8d0471022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:07.491187 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ef8a4b53-8fc3-4fde-b2b3-f1e8d0471022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:07.492147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ef8a4b53-8fc3-4fde-b2b3-f1e8d0471022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:07.492585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ef8a4b53-8fc3-4fde-b2b3-f1e8d0471022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:07.633226 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ef8a4b53-8fc3-4fde-b2b3-f1e8d0471022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:07.641779 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ef8a4b53-8fc3-4fde-b2b3-f1e8d0471022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.164261 Jun 16 12:00:07.651715 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 301/583] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:07 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:08.255313 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1c8191e5-0e65-4c1a-ae58-6388bdb8a97e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:08.259239 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1c8191e5-0e65-4c1a-ae58-6388bdb8a97e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:08.263644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1c8191e5-0e65-4c1a-ae58-6388bdb8a97e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:08.263829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1c8191e5-0e65-4c1a-ae58-6388bdb8a97e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:08.264646 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1c8191e5-0e65-4c1a-ae58-6388bdb8a97e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:08.265072 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1c8191e5-0e65-4c1a-ae58-6388bdb8a97e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:08.418734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1c8191e5-0e65-4c1a-ae58-6388bdb8a97e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:08.426552 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1c8191e5-0e65-4c1a-ae58-6388bdb8a97e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1680 microversion: 2.1 time: 0.176882 Jun 16 12:00:08.427132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 283/584] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:08 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:08.659585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cfc2a5db-188a-4b02-9e4c-9a2b5031fdba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:08.660314 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cfc2a5db-188a-4b02-9e4c-9a2b5031fdba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:08.670646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cfc2a5db-188a-4b02-9e4c-9a2b5031fdba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:08.671194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cfc2a5db-188a-4b02-9e4c-9a2b5031fdba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:08.672518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cfc2a5db-188a-4b02-9e4c-9a2b5031fdba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:08.673177 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cfc2a5db-188a-4b02-9e4c-9a2b5031fdba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:08.833642 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cfc2a5db-188a-4b02-9e4c-9a2b5031fdba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:08.842897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cfc2a5db-188a-4b02-9e4c-9a2b5031fdba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.187281 Jun 16 12:00:08.843533 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 302/585] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:08 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:09.444622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e771ba48-2d0e-4d02-80e2-1d6c25f1a205 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:09.445185 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e771ba48-2d0e-4d02-80e2-1d6c25f1a205 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:09.451972 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e771ba48-2d0e-4d02-80e2-1d6c25f1a205 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:09.452494 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e771ba48-2d0e-4d02-80e2-1d6c25f1a205 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:09.453335 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e771ba48-2d0e-4d02-80e2-1d6c25f1a205 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:09.453974 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e771ba48-2d0e-4d02-80e2-1d6c25f1a205 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:09.594737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e771ba48-2d0e-4d02-80e2-1d6c25f1a205 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:09.602037 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e771ba48-2d0e-4d02-80e2-1d6c25f1a205 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1657 microversion: 2.1 time: 0.161460 Jun 16 12:00:09.602595 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 284/586] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:09 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1657 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:09.624461 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-61877364-0a20-4ee9-b6d0-a07c7279e014 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:09.630712 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61877364-0a20-4ee9-b6d0-a07c7279e014 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:09.631161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61877364-0a20-4ee9-b6d0-a07c7279e014 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:09.654210 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-61877364-0a20-4ee9-b6d0-a07c7279e014 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Going to try to start instance {{(pid=125054) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 12:00:09.860482 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-dbdf60ff-f8db-45bd-ba58-2a12a6fe42a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:09.861091 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-dbdf60ff-f8db-45bd-ba58-2a12a6fe42a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:09.866197 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-61877364-0a20-4ee9-b6d0-a07c7279e014 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/action" status: 202 len: 0 microversion: 2.1 time: 0.245347 Jun 16 12:00:09.867082 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 303/587] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 12:00:09 2022] POST /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:00:09.867201 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dbdf60ff-f8db-45bd-ba58-2a12a6fe42a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:09.870815 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dbdf60ff-f8db-45bd-ba58-2a12a6fe42a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:09.870815 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dbdf60ff-f8db-45bd-ba58-2a12a6fe42a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:09.870815 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dbdf60ff-f8db-45bd-ba58-2a12a6fe42a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:09.875409 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6a8ea8a8-9ca9-4bc9-a39c-725e7be71eb0 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:09.876128 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6a8ea8a8-9ca9-4bc9-a39c-725e7be71eb0 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:09.882539 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6a8ea8a8-9ca9-4bc9-a39c-725e7be71eb0 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:09.882987 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6a8ea8a8-9ca9-4bc9-a39c-725e7be71eb0 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:09.883758 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6a8ea8a8-9ca9-4bc9-a39c-725e7be71eb0 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:09.884232 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6a8ea8a8-9ca9-4bc9-a39c-725e7be71eb0 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:10.053547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6a8ea8a8-9ca9-4bc9-a39c-725e7be71eb0 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:10.074711 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6a8ea8a8-9ca9-4bc9-a39c-725e7be71eb0 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1666 microversion: 2.1 time: 0.202858 Jun 16 12:00:10.076033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 304/588] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:09 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1666 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:10.126798 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-dbdf60ff-f8db-45bd-ba58-2a12a6fe42a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:10.142572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-dbdf60ff-f8db-45bd-ba58-2a12a6fe42a6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.285703 Jun 16 12:00:10.155039 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 285/589] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:09 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:11.093310 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8f672f15-7a99-418b-b3ea-fd088503ec7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:11.095040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8f672f15-7a99-418b-b3ea-fd088503ec7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:11.102392 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8f672f15-7a99-418b-b3ea-fd088503ec7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:11.103116 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8f672f15-7a99-418b-b3ea-fd088503ec7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:11.104208 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8f672f15-7a99-418b-b3ea-fd088503ec7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:11.105491 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8f672f15-7a99-418b-b3ea-fd088503ec7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:11.161979 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6e2f2709-a3fb-4b9d-a6ce-7bb25aa4f503 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:11.163406 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6e2f2709-a3fb-4b9d-a6ce-7bb25aa4f503 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:11.171758 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e2f2709-a3fb-4b9d-a6ce-7bb25aa4f503 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:11.172574 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e2f2709-a3fb-4b9d-a6ce-7bb25aa4f503 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:11.173581 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e2f2709-a3fb-4b9d-a6ce-7bb25aa4f503 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:11.174066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6e2f2709-a3fb-4b9d-a6ce-7bb25aa4f503 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:11.284945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8f672f15-7a99-418b-b3ea-fd088503ec7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:11.296660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8f672f15-7a99-418b-b3ea-fd088503ec7b tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1666 microversion: 2.1 time: 0.207157 Jun 16 12:00:11.306841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 305/590] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:11 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1666 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:11.335634 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6e2f2709-a3fb-4b9d-a6ce-7bb25aa4f503 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:11.345770 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6e2f2709-a3fb-4b9d-a6ce-7bb25aa4f503 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.187565 Jun 16 12:00:11.346608 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 286/591] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:11 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:12.314457 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f7dbe2c8-4213-4cf7-b647-ea832df7d25a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:12.315223 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f7dbe2c8-4213-4cf7-b647-ea832df7d25a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:12.322441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f7dbe2c8-4213-4cf7-b647-ea832df7d25a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:12.323227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f7dbe2c8-4213-4cf7-b647-ea832df7d25a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:12.324348 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f7dbe2c8-4213-4cf7-b647-ea832df7d25a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:12.325014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f7dbe2c8-4213-4cf7-b647-ea832df7d25a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:12.363932 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0cc288bd-9d4a-41b3-bccf-38c9b75931a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:12.365124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0cc288bd-9d4a-41b3-bccf-38c9b75931a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:12.373026 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0cc288bd-9d4a-41b3-bccf-38c9b75931a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:12.373877 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0cc288bd-9d4a-41b3-bccf-38c9b75931a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:12.374822 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0cc288bd-9d4a-41b3-bccf-38c9b75931a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:12.375445 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0cc288bd-9d4a-41b3-bccf-38c9b75931a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:12.483679 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f7dbe2c8-4213-4cf7-b647-ea832df7d25a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:12.492884 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f7dbe2c8-4213-4cf7-b647-ea832df7d25a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1670 microversion: 2.1 time: 0.182207 Jun 16 12:00:12.504877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 306/592] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:12 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:12.522962 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0cc288bd-9d4a-41b3-bccf-38c9b75931a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:12.532396 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0cc288bd-9d4a-41b3-bccf-38c9b75931a9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.172242 Jun 16 12:00:12.533279 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 287/593] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:12 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:13.549812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-debf67ea-d21c-4cc2-b4e8-7d95815545de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:13.551445 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-debf67ea-d21c-4cc2-b4e8-7d95815545de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:13.568507 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-debf67ea-d21c-4cc2-b4e8-7d95815545de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:13.569095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-debf67ea-d21c-4cc2-b4e8-7d95815545de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:13.570257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-debf67ea-d21c-4cc2-b4e8-7d95815545de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:13.570806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-debf67ea-d21c-4cc2-b4e8-7d95815545de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:13.760366 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-debf67ea-d21c-4cc2-b4e8-7d95815545de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:13.774916 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-debf67ea-d21c-4cc2-b4e8-7d95815545de tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.228603 Jun 16 12:00:13.780797 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 307/594] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:13 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:14.797303 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a29cdbf0-7311-4f48-b7f8-8fbe62229ccf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:14.798610 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a29cdbf0-7311-4f48-b7f8-8fbe62229ccf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:14.807107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a29cdbf0-7311-4f48-b7f8-8fbe62229ccf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:14.808857 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a29cdbf0-7311-4f48-b7f8-8fbe62229ccf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:14.810071 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a29cdbf0-7311-4f48-b7f8-8fbe62229ccf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:14.810764 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a29cdbf0-7311-4f48-b7f8-8fbe62229ccf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:14.943154 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a29cdbf0-7311-4f48-b7f8-8fbe62229ccf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:14.958754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a29cdbf0-7311-4f48-b7f8-8fbe62229ccf tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.165144 Jun 16 12:00:14.960106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 288/595] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:14 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:15.818247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8d27a0a7-2574-4669-8060-49cbb438d371 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d84767a2-f23e-4137-858b-fe12cd5544cc", "device": "/dev/sdb"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:15.820712 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8d27a0a7-2574-4669-8060-49cbb438d371 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:15.831254 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d27a0a7-2574-4669-8060-49cbb438d371 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:15.831701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d27a0a7-2574-4669-8060-49cbb438d371 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:15.832512 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d27a0a7-2574-4669-8060-49cbb438d371 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:15.832940 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d27a0a7-2574-4669-8060-49cbb438d371 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:15.977320 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4417908b-fbce-4cde-ba76-4f955ffd62ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:15.983435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4417908b-fbce-4cde-ba76-4f955ffd62ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:15.985738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4417908b-fbce-4cde-ba76-4f955ffd62ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:15.986193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4417908b-fbce-4cde-ba76-4f955ffd62ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:15.987001 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4417908b-fbce-4cde-ba76-4f955ffd62ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:15.987438 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4417908b-fbce-4cde-ba76-4f955ffd62ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:16.005161 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=100 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:16.125106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4417908b-fbce-4cde-ba76-4f955ffd62ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:16.133148 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4417908b-fbce-4cde-ba76-4f955ffd62ce tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1735 microversion: 2.1 time: 0.159931 Jun 16 12:00:16.136681 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 289/596] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:15 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:17.067580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8d27a0a7-2574-4669-8060-49cbb438d371 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "POST /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.253086 Jun 16 12:00:17.068725 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 308/597] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:00:15 2022] POST /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326/os-volume_attachments => generated 194 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:17.151493 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8ca40db6-a25e-4465-8d3a-216c136c8aa7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:17.154345 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8ca40db6-a25e-4465-8d3a-216c136c8aa7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:17.163797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8ca40db6-a25e-4465-8d3a-216c136c8aa7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:17.164346 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8ca40db6-a25e-4465-8d3a-216c136c8aa7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:17.165182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8ca40db6-a25e-4465-8d3a-216c136c8aa7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:17.165741 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8ca40db6-a25e-4465-8d3a-216c136c8aa7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:17.330872 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8ca40db6-a25e-4465-8d3a-216c136c8aa7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:17.340967 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8ca40db6-a25e-4465-8d3a-216c136c8aa7 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1715 microversion: 2.1 time: 0.193520 Jun 16 12:00:17.341542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 290/598] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:17 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1715 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:17.454213 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:17.455090 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:17.461665 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:17.462199 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:17.463045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:17.463688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:17.597613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] HTTP exception thrown: Cannot 'detach_volume' instance 5c202b5a-d86c-445a-9119-9b0893b15c1f while it is in vm_state rescued Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Request method failure captured: Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: DELETE /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments/9465cb0d-5830-441c-a73a-1a6f899ef823 HTTP/1.1 Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpc5yamDpiSB8f7OnESQ50cHNirlCnyBfPHjqjB2vSHropmWxfJeAbxensZSeje0UBxZtS1HNRcfksjlI8EJUoG4R3_riom8WCNK9__EeEp9jMVJvO38Uq6nurzXiWCO-8HNMoTEdxp17CohHT0K0EyN4HbiE1r6_iJ8WtFdSM9gGI Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:00:17.599382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 6cdd0a7f3f12414ea85ebffc9d531773 Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:00:17.601006 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Cannot 'detach_volume' instance 5c202b5a-d86c-445a-9119-9b0893b15c1f while it is in vm_state rescued Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'server_id': '5c202b5a-d86c-445a-9119-9b0893b15c1f', 'id': '9465cb0d-5830-441c-a73a-1a6f899ef823'} Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5c202b5a-d86c-445a-9119-9b0893b15c1f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:00:17.601841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5c202b5a-d86c-445a-9119-9b0893b15c1f while it is in vm_state rescued Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5c202b5a-d86c-445a-9119-9b0893b15c1f while it is in vm_state rescued Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:17.603333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Returning 409 to user: Cannot 'detach_volume' instance 5c202b5a-d86c-445a-9119-9b0893b15c1f while it is in vm_state rescued {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:00:17.604570 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-270b9892-ec20-436a-bdf7-c4ddc1672751 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments/9465cb0d-5830-441c-a73a-1a6f899ef823" status: 409 len: 152 microversion: 2.1 time: 0.151148 Jun 16 12:00:17.604570 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 309/599] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:00:17 2022] DELETE /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments/9465cb0d-5830-441c-a73a-1a6f899ef823 => generated 152 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 12:00:17.613800 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ffa0a57e-aee3-4bbb-ad63-db6fb3bc013c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:17.614334 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ffa0a57e-aee3-4bbb-ad63-db6fb3bc013c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:17.621411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ffa0a57e-aee3-4bbb-ad63-db6fb3bc013c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:17.621875 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ffa0a57e-aee3-4bbb-ad63-db6fb3bc013c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:17.622630 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ffa0a57e-aee3-4bbb-ad63-db6fb3bc013c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:17.623070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ffa0a57e-aee3-4bbb-ad63-db6fb3bc013c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:17.887192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ffa0a57e-aee3-4bbb-ad63-db6fb3bc013c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "POST /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/action" status: 202 len: 0 microversion: 2.1 time: 0.276112 Jun 16 12:00:17.891396 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 291/600] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 12:00:17 2022] POST /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:00:17.897237 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f5f6d805-fa39-426b-9dac-2bdb60fb7579 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:17.898142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f5f6d805-fa39-426b-9dac-2bdb60fb7579 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:17.908937 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5f6d805-fa39-426b-9dac-2bdb60fb7579 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:17.909705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5f6d805-fa39-426b-9dac-2bdb60fb7579 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:17.910851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5f6d805-fa39-426b-9dac-2bdb60fb7579 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:17.931394 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5f6d805-fa39-426b-9dac-2bdb60fb7579 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:18.115695 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f5f6d805-fa39-426b-9dac-2bdb60fb7579 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:18.126037 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f5f6d805-fa39-426b-9dac-2bdb60fb7579 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1723 microversion: 2.1 time: 0.233341 Jun 16 12:00:18.127221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 310/601] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:17 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:19.144643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fff91795-62af-49c6-a5cb-19fa0b8800ba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:19.145339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fff91795-62af-49c6-a5cb-19fa0b8800ba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:19.151617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fff91795-62af-49c6-a5cb-19fa0b8800ba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:19.152968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fff91795-62af-49c6-a5cb-19fa0b8800ba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:19.155540 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fff91795-62af-49c6-a5cb-19fa0b8800ba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:19.155540 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fff91795-62af-49c6-a5cb-19fa0b8800ba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:19.310960 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fff91795-62af-49c6-a5cb-19fa0b8800ba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:19.320684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fff91795-62af-49c6-a5cb-19fa0b8800ba tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1723 microversion: 2.1 time: 0.180841 Jun 16 12:00:19.321410 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 292/602] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:19 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:20.338149 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8d54a8c1-fc88-4c4c-9613-8343bc6674af tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:20.338875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8d54a8c1-fc88-4c4c-9613-8343bc6674af tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:20.346159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d54a8c1-fc88-4c4c-9613-8343bc6674af tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:20.346599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d54a8c1-fc88-4c4c-9613-8343bc6674af tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:20.347349 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d54a8c1-fc88-4c4c-9613-8343bc6674af tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:20.347778 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8d54a8c1-fc88-4c4c-9613-8343bc6674af tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:20.478402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8d54a8c1-fc88-4c4c-9613-8343bc6674af tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:20.486451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8d54a8c1-fc88-4c4c-9613-8343bc6674af tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1723 microversion: 2.1 time: 0.152176 Jun 16 12:00:20.487061 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 311/603] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:20 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:21.506784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-735333fa-8aa8-4b3b-a998-e36a1e70f058 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:21.507394 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-735333fa-8aa8-4b3b-a998-e36a1e70f058 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:21.514080 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-735333fa-8aa8-4b3b-a998-e36a1e70f058 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:21.514533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-735333fa-8aa8-4b3b-a998-e36a1e70f058 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:21.515299 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-735333fa-8aa8-4b3b-a998-e36a1e70f058 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:21.515732 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-735333fa-8aa8-4b3b-a998-e36a1e70f058 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:21.648719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-735333fa-8aa8-4b3b-a998-e36a1e70f058 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:21.657410 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-735333fa-8aa8-4b3b-a998-e36a1e70f058 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1729 microversion: 2.1 time: 0.154655 Jun 16 12:00:21.657983 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 293/604] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:21 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:21.678110 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-49266a09-6798-4596-bfc0-71e82fac59a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:21.678604 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-49266a09-6798-4596-bfc0-71e82fac59a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:21.685730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-49266a09-6798-4596-bfc0-71e82fac59a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:21.689860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-49266a09-6798-4596-bfc0-71e82fac59a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:21.689860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-49266a09-6798-4596-bfc0-71e82fac59a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:21.689860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-49266a09-6798-4596-bfc0-71e82fac59a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:21.766198 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-49266a09-6798-4596-bfc0-71e82fac59a0 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096108 Jun 16 12:00:21.766779 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 312/605] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 12:00:21 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:22.887128 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-390a4c54-ff3e-408a-9617-84d0e815cf7d req-e830d986-68c7-40ec-86d5-3d489eeddc72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c202b5a-d86c-445a-9119-9b0893b15c1f", "tag": "f40c01cc-1a91-4c00-ac75-2e413104f6db"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:22.896220 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-390a4c54-ff3e-408a-9617-84d0e815cf7d req-e830d986-68c7-40ec-86d5-3d489eeddc72 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:22.896888 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-390a4c54-ff3e-408a-9617-84d0e815cf7d req-e830d986-68c7-40ec-86d5-3d489eeddc72 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:22.909365 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-390a4c54-ff3e-408a-9617-84d0e815cf7d req-e830d986-68c7-40ec-86d5-3d489eeddc72 service nova] Creating event network-changed:f40c01cc-1a91-4c00-ac75-2e413104f6db for instance 5c202b5a-d86c-445a-9119-9b0893b15c1f on hv-cinder-84614 Jun 16 12:00:22.919749 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-390a4c54-ff3e-408a-9617-84d0e815cf7d req-e830d986-68c7-40ec-86d5-3d489eeddc72 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036073 Jun 16 12:00:22.920378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 294/606] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:24.294253 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-85b2415d-ae68-4c2c-8350-f58010a8c9e3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1811487829"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:24.294771 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-85b2415d-ae68-4c2c-8350-f58010a8c9e3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:24.302392 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85b2415d-ae68-4c2c-8350-f58010a8c9e3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:24.302838 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85b2415d-ae68-4c2c-8350-f58010a8c9e3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:24.303604 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85b2415d-ae68-4c2c-8350-f58010a8c9e3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:24.304439 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85b2415d-ae68-4c2c-8350-f58010a8c9e3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:24.440300 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.network.security_group_api [None req-85b2415d-ae68-4c2c-8350-f58010a8c9e3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Removing security group 9262f9a3-f86d-4833-a163-42ecdbf584e6 from port 615b821c-cb44-4dee-9938-fc6957f26847 Jun 16 12:00:24.921351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-85b2415d-ae68-4c2c-8350-f58010a8c9e3 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "POST /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/action" status: 202 len: 0 microversion: 2.1 time: 0.631575 Jun 16 12:00:24.922452 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 313/607] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 12:00:24 2022] POST /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 12:00:24.942032 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-928d0dc8-0886-4f7a-936e-5a056c06af87 req-614429d2-fd64-4742-b946-7478b7906bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c202b5a-d86c-445a-9119-9b0893b15c1f", "tag": "f40c01cc-1a91-4c00-ac75-2e413104f6db"}, {"name": "network-changed", "server_uuid": "67e80655-be0f-41d4-98b2-feea6405ace6", "tag": "615b821c-cb44-4dee-9938-fc6957f26847"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:24.968897 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-928d0dc8-0886-4f7a-936e-5a056c06af87 req-614429d2-fd64-4742-b946-7478b7906bcc service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:24.969345 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-928d0dc8-0886-4f7a-936e-5a056c06af87 req-614429d2-fd64-4742-b946-7478b7906bcc service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:25.004160 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-928d0dc8-0886-4f7a-936e-5a056c06af87 req-614429d2-fd64-4742-b946-7478b7906bcc service nova] Creating event network-changed:f40c01cc-1a91-4c00-ac75-2e413104f6db for instance 5c202b5a-d86c-445a-9119-9b0893b15c1f on hv-cinder-84614 Jun 16 12:00:25.005087 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-928d0dc8-0886-4f7a-936e-5a056c06af87 req-614429d2-fd64-4742-b946-7478b7906bcc service nova] Creating event network-changed:615b821c-cb44-4dee-9938-fc6957f26847 for instance 67e80655-be0f-41d4-98b2-feea6405ace6 on hv-cinder-84614 Jun 16 12:00:25.014797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-928d0dc8-0886-4f7a-936e-5a056c06af87 req-614429d2-fd64-4742-b946-7478b7906bcc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083240 Jun 16 12:00:25.020904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 295/608] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:00:26.381970 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-90ea9452-cf5d-48d6-8191-944519695aa1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:26.382615 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-90ea9452-cf5d-48d6-8191-944519695aa1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:26.389807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-90ea9452-cf5d-48d6-8191-944519695aa1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:26.390365 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-90ea9452-cf5d-48d6-8191-944519695aa1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:26.391219 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-90ea9452-cf5d-48d6-8191-944519695aa1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:26.391716 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-90ea9452-cf5d-48d6-8191-944519695aa1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:26.477130 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:26.482485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-90ea9452-cf5d-48d6-8191-944519695aa1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lazy-loading 'services' on Instance uuid 67e80655-be0f-41d4-98b2-feea6405ace6 {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:00:26.766698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-90ea9452-cf5d-48d6-8191-944519695aa1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments/bb1b49c6-0eef-4145-b506-3d0270d09d01" status: 202 len: 0 microversion: 2.1 time: 0.388959 Jun 16 12:00:26.767285 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 314/609] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:00:26 2022] DELETE /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments/bb1b49c6-0eef-4145-b506-3d0270d09d01 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:00:26.777345 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7dd208b6-9823-4609-89e9-3716053d84e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:26.778599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7dd208b6-9823-4609-89e9-3716053d84e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:26.784859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7dd208b6-9823-4609-89e9-3716053d84e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:26.785306 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7dd208b6-9823-4609-89e9-3716053d84e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:26.786084 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7dd208b6-9823-4609-89e9-3716053d84e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:26.786496 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7dd208b6-9823-4609-89e9-3716053d84e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:26.816247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7dd208b6-9823-4609-89e9-3716053d84e9 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044251 Jun 16 12:00:26.816824 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 296/610] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:00:26 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:27.031707 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-b1f6be74-bfb9-4d17-9637-49e0b03f1233 req-7c8b0cc0-9b6b-45ca-b50d-74228efabec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e80655-be0f-41d4-98b2-feea6405ace6", "tag": "615b821c-cb44-4dee-9938-fc6957f26847"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:27.040395 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-b1f6be74-bfb9-4d17-9637-49e0b03f1233 req-7c8b0cc0-9b6b-45ca-b50d-74228efabec5 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:27.040832 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-b1f6be74-bfb9-4d17-9637-49e0b03f1233 req-7c8b0cc0-9b6b-45ca-b50d-74228efabec5 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:27.052138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-b1f6be74-bfb9-4d17-9637-49e0b03f1233 req-7c8b0cc0-9b6b-45ca-b50d-74228efabec5 service nova] Creating event network-changed:615b821c-cb44-4dee-9938-fc6957f26847 for instance 67e80655-be0f-41d4-98b2-feea6405ace6 on hv-cinder-84614 Jun 16 12:00:27.056967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-b1f6be74-bfb9-4d17-9637-49e0b03f1233 req-7c8b0cc0-9b6b-45ca-b50d-74228efabec5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029734 Jun 16 12:00:27.057549 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 315/611] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:27.828439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1d8c0788-e890-4e4e-b703-33964d1851ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:27.830652 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1d8c0788-e890-4e4e-b703-33964d1851ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:27.837277 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1d8c0788-e890-4e4e-b703-33964d1851ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:27.837719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1d8c0788-e890-4e4e-b703-33964d1851ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:27.838665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1d8c0788-e890-4e4e-b703-33964d1851ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:27.839706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1d8c0788-e890-4e4e-b703-33964d1851ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:27.871148 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1d8c0788-e890-4e4e-b703-33964d1851ba tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047514 Jun 16 12:00:27.875287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 297/612] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:00:27 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:28.884113 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7db1c088-cbb5-4f2a-8713-5e4be64e7db1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:28.885300 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7db1c088-cbb5-4f2a-8713-5e4be64e7db1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:28.887540 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=46 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:28.893321 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7db1c088-cbb5-4f2a-8713-5e4be64e7db1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:28.893842 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7db1c088-cbb5-4f2a-8713-5e4be64e7db1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:28.900384 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7db1c088-cbb5-4f2a-8713-5e4be64e7db1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:28.900384 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7db1c088-cbb5-4f2a-8713-5e4be64e7db1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:28.935183 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7db1c088-cbb5-4f2a-8713-5e4be64e7db1 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056075 Jun 16 12:00:28.938978 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 316/613] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:00:28 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:29.946539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c6dd8b3e-9dff-41c3-887d-ac78009c66b2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:29.947465 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c6dd8b3e-9dff-41c3-887d-ac78009c66b2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:29.954316 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c6dd8b3e-9dff-41c3-887d-ac78009c66b2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:29.954756 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c6dd8b3e-9dff-41c3-887d-ac78009c66b2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:29.955523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c6dd8b3e-9dff-41c3-887d-ac78009c66b2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:29.955977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c6dd8b3e-9dff-41c3-887d-ac78009c66b2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:29.997930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c6dd8b3e-9dff-41c3-887d-ac78009c66b2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055161 Jun 16 12:00:29.998498 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 298/614] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:00:29 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 12:00:30.008372 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:30.009512 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:30.018025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:30.018765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:30.019724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:30.020579 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:30.116688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] HTTP exception thrown: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 is not attached to volume bb1b49c6-0eef-4145-b506-3d0270d09d01 Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Request method failure captured: Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: DELETE /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments/bb1b49c6-0eef-4145-b506-3d0270d09d01 HTTP/1.1 Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxqQBea-m6wtIVCgl5Pgi-rPytmampNylG4ihKw3OivcEB-po7bno-6OyaAnpxHTGZC5ZOzAcUxXTZcVg1Nd-jIHcmghq_d83pJ11BHtSEPOvc6mG1aRGNWMM3PfkP3rnSxwKxcOg3QpTIQyHj-7eidEqvUcr6uEiN7cZW8-Kbf2g5I Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 345dc1b6fec149e88f1be7837d126d20 Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-TestMinimumBasicScenario-1724049969 Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:00:30.119350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/345dc1b6fec149e88f1be7837d126d20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_345dc1b6fec149e88f1be7837d126d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/345dc1b6fec149e88f1be7837d126d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/345dc1b6fec149e88f1be7837d126d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-TestMinimumBasicScenario-1724049969 Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 345dc1b6fec149e88f1be7837d126d20 Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1724049969 Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-TestMinimumBasicScenario-1724049969-project Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: e6730f4274e240dd9da30e5c3bc3679b Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-TestMinimumBasicScenario-1724049969-project Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:00:30.121525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 is not attached to volume bb1b49c6-0eef-4145-b506-3d0270d09d01 Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'server_id': '67e80655-be0f-41d4-98b2-feea6405ace6', 'id': 'bb1b49c6-0eef-4145-b506-3d0270d09d01'} Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bb1b49c6-0eef-4145-b506-3d0270d09d01. Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:00:30.122342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 is not attached to volume bb1b49c6-0eef-4145-b506-3d0270d09d01 Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 is not attached to volume bb1b49c6-0eef-4145-b506-3d0270d09d01 Jun 16 12:00:30.123724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:00:30.125996 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Returning 404 to user: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 is not attached to volume bb1b49c6-0eef-4145-b506-3d0270d09d01 {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:00:30.127162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5a3a5bad-17ca-43ad-a015-e9b47fb5f657 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments/bb1b49c6-0eef-4145-b506-3d0270d09d01" status: 404 len: 154 microversion: 2.1 time: 0.122876 Jun 16 12:00:30.128213 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 317/615] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:00:30 2022] DELETE /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6/os-volume_attachments/bb1b49c6-0eef-4145-b506-3d0270d09d01 => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:00:30.425450 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f31539e3-3944-42a5-93e9-ab884c29518a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:30.425944 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f31539e3-3944-42a5-93e9-ab884c29518a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:30.432592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f31539e3-3944-42a5-93e9-ab884c29518a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:30.433374 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f31539e3-3944-42a5-93e9-ab884c29518a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:30.434379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f31539e3-3944-42a5-93e9-ab884c29518a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:30.435282 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f31539e3-3944-42a5-93e9-ab884c29518a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:30.468152 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f31539e3-3944-42a5-93e9-ab884c29518a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments/db98670e-4fdc-4ca0-8f81-90fa94b2388e" status: 200 len: 194 microversion: 2.20 time: 0.046755 Jun 16 12:00:30.469468 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 299/616] 10.222.0.40 () {60 vars in 1453 bytes} [Thu Jun 16 12:00:30 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments/db98670e-4fdc-4ca0-8f81-90fa94b2388e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:00:30.543109 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9d3aaa34-062c-4232-a432-4656aa3a5655 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:30.543596 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9d3aaa34-062c-4232-a432-4656aa3a5655 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:30.549674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9d3aaa34-062c-4232-a432-4656aa3a5655 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:30.550112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9d3aaa34-062c-4232-a432-4656aa3a5655 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:30.550863 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9d3aaa34-062c-4232-a432-4656aa3a5655 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:30.551290 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9d3aaa34-062c-4232-a432-4656aa3a5655 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:30.656537 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-9d3aaa34-062c-4232-a432-4656aa3a5655 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lazy-loading 'services' on Instance uuid 6646f09a-70e9-487b-98f0-89ab1fe5508a {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:00:30.906757 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9d3aaa34-062c-4232-a432-4656aa3a5655 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments/db98670e-4fdc-4ca0-8f81-90fa94b2388e" status: 202 len: 0 microversion: 2.20 time: 0.367203 Jun 16 12:00:30.907099 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 318/617] 10.222.0.40 () {60 vars in 1456 bytes} [Thu Jun 16 12:00:30 2022] DELETE /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments/db98670e-4fdc-4ca0-8f81-90fa94b2388e => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:00:30.916267 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-17943309-8bf1-466b-8ca9-e0a9882dcb04 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:30.917227 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-17943309-8bf1-466b-8ca9-e0a9882dcb04 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:30.923342 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17943309-8bf1-466b-8ca9-e0a9882dcb04 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:30.924038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17943309-8bf1-466b-8ca9-e0a9882dcb04 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:30.925063 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17943309-8bf1-466b-8ca9-e0a9882dcb04 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:30.925673 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17943309-8bf1-466b-8ca9-e0a9882dcb04 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:30.958206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-17943309-8bf1-466b-8ca9-e0a9882dcb04 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046305 Jun 16 12:00:30.959829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 300/618] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jun 16 12:00:30 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:00:31.972288 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4bca856f-e7e0-4e4a-b1b1-813b3ad004ae tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:31.973339 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4bca856f-e7e0-4e4a-b1b1-813b3ad004ae tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:31.980174 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4bca856f-e7e0-4e4a-b1b1-813b3ad004ae tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:31.980618 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4bca856f-e7e0-4e4a-b1b1-813b3ad004ae tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:31.981380 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4bca856f-e7e0-4e4a-b1b1-813b3ad004ae tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:31.981812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4bca856f-e7e0-4e4a-b1b1-813b3ad004ae tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:32.018043 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4bca856f-e7e0-4e4a-b1b1-813b3ad004ae tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050948 Jun 16 12:00:32.018621 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 319/619] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jun 16 12:00:31 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:00:33.034968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fd3647ed-022a-4570-bddf-8b4e99cdb4e0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:33.036117 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fd3647ed-022a-4570-bddf-8b4e99cdb4e0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:33.043594 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fd3647ed-022a-4570-bddf-8b4e99cdb4e0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:33.044082 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fd3647ed-022a-4570-bddf-8b4e99cdb4e0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:33.047829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fd3647ed-022a-4570-bddf-8b4e99cdb4e0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:33.048553 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fd3647ed-022a-4570-bddf-8b4e99cdb4e0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:33.084362 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fd3647ed-022a-4570-bddf-8b4e99cdb4e0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053269 Jun 16 12:00:33.084898 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 301/620] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jun 16 12:00:33 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:00:33.561482 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e40625e5-1a80-43a3-9cf1-063a055f9db2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:33.561965 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e40625e5-1a80-43a3-9cf1-063a055f9db2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:33.568407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e40625e5-1a80-43a3-9cf1-063a055f9db2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:33.568849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e40625e5-1a80-43a3-9cf1-063a055f9db2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:33.569632 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e40625e5-1a80-43a3-9cf1-063a055f9db2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:33.570265 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e40625e5-1a80-43a3-9cf1-063a055f9db2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:33.595068 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e40625e5-1a80-43a3-9cf1-063a055f9db2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:00:34.003726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e40625e5-1a80-43a3-9cf1-063a055f9db2 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 204 len: 0 microversion: 2.1 time: 0.444717 Jun 16 12:00:34.004790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 320/621] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:00:33 2022] DELETE /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:00:34.013649 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3e39c02b-6a9a-4e39-9e50-4890f2f43b48 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:34.014379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3e39c02b-6a9a-4e39-9e50-4890f2f43b48 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:34.024679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e39c02b-6a9a-4e39-9e50-4890f2f43b48 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:34.025025 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e39c02b-6a9a-4e39-9e50-4890f2f43b48 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:34.025804 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e39c02b-6a9a-4e39-9e50-4890f2f43b48 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:34.028010 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e39c02b-6a9a-4e39-9e50-4890f2f43b48 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:34.100083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bd998b7f-0e9a-44b6-9e54-b9834fa19875 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:34.102509 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bd998b7f-0e9a-44b6-9e54-b9834fa19875 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:34.110812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd998b7f-0e9a-44b6-9e54-b9834fa19875 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:34.116685 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd998b7f-0e9a-44b6-9e54-b9834fa19875 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:34.116685 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd998b7f-0e9a-44b6-9e54-b9834fa19875 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:34.116685 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd998b7f-0e9a-44b6-9e54-b9834fa19875 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:34.150532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bd998b7f-0e9a-44b6-9e54-b9834fa19875 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056602 Jun 16 12:00:34.152539 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 321/622] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jun 16 12:00:34 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:34.233106 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6d0cd15f-7f56-4014-81d3-b34ba49074b5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:34.233600 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6d0cd15f-7f56-4014-81d3-b34ba49074b5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:34.246191 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d0cd15f-7f56-4014-81d3-b34ba49074b5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:34.247028 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d0cd15f-7f56-4014-81d3-b34ba49074b5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:34.249450 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d0cd15f-7f56-4014-81d3-b34ba49074b5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:34.250468 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d0cd15f-7f56-4014-81d3-b34ba49074b5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:34.252593 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3e39c02b-6a9a-4e39-9e50-4890f2f43b48 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:34.266751 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3e39c02b-6a9a-4e39-9e50-4890f2f43b48 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1555 microversion: 2.1 time: 0.257394 Jun 16 12:00:34.271605 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 302/623] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:34 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:34.293457 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6d0cd15f-7f56-4014-81d3-b34ba49074b5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:00:34.602385 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6d0cd15f-7f56-4014-81d3-b34ba49074b5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 204 len: 0 microversion: 2.20 time: 0.373279 Jun 16 12:00:34.603166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 322/624] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jun 16 12:00:34 2022] DELETE /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 12:00:34.612164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:34.612754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:34.621092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:34.621548 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:34.622784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:34.623214 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:34.768888 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:34.778372 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:34.779887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:34.781029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0b867b82-9a2d-4c44-8a48-608ef7a8df60 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.173005 Jun 16 12:00:34.782058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 303/625] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:34 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:35.286191 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-029c382d-817d-46da-b378-2be2ab7c434f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:35.287811 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-029c382d-817d-46da-b378-2be2ab7c434f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:35.296220 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-029c382d-817d-46da-b378-2be2ab7c434f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:35.296950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-029c382d-817d-46da-b378-2be2ab7c434f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:35.297739 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-029c382d-817d-46da-b378-2be2ab7c434f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:35.299263 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-029c382d-817d-46da-b378-2be2ab7c434f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:35.560875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-029c382d-817d-46da-b378-2be2ab7c434f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:35.579743 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-029c382d-817d-46da-b378-2be2ab7c434f tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1555 microversion: 2.1 time: 0.298457 Jun 16 12:00:35.580354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 323/626] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:35 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1555 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:35.799803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:35.800623 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:35.803835 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=48 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:35.811225 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:35.811936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:35.813049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:35.813762 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:35.955377 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:35.964050 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:35.965925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:35.967265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ceb230d8-201d-4859-90c2-f7b993b18f93 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.171436 Jun 16 12:00:35.967829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 304/627] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:35 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:36.601782 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5430aa37-48ac-4325-89c8-aa78c4920ecf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:36.602994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5430aa37-48ac-4325-89c8-aa78c4920ecf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:36.610783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5430aa37-48ac-4325-89c8-aa78c4920ecf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:36.611698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5430aa37-48ac-4325-89c8-aa78c4920ecf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:36.612735 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5430aa37-48ac-4325-89c8-aa78c4920ecf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:36.613427 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5430aa37-48ac-4325-89c8-aa78c4920ecf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:36.874526 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5430aa37-48ac-4325-89c8-aa78c4920ecf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:36.884565 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5430aa37-48ac-4325-89c8-aa78c4920ecf tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1555 microversion: 2.1 time: 0.290722 Jun 16 12:00:36.896024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 324/628] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:36 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1555 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:36.987226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:36.989376 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:37.001221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:37.002001 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:37.003919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:37.004709 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:37.176982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:37.185739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:37.187599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:37.188787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-09f161ef-ea74-4257-a2bd-5a8e416394b3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.206101 Jun 16 12:00:37.189347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 305/629] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:36 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:37.901894 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d2ec7328-8344-4037-8e7c-d4f5fcb03675 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:37.902795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d2ec7328-8344-4037-8e7c-d4f5fcb03675 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:37.908931 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2ec7328-8344-4037-8e7c-d4f5fcb03675 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:37.909367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2ec7328-8344-4037-8e7c-d4f5fcb03675 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:37.910118 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2ec7328-8344-4037-8e7c-d4f5fcb03675 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:37.910560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d2ec7328-8344-4037-8e7c-d4f5fcb03675 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:38.167755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d2ec7328-8344-4037-8e7c-d4f5fcb03675 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:38.180435 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d2ec7328-8344-4037-8e7c-d4f5fcb03675 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1555 microversion: 2.1 time: 0.282720 Jun 16 12:00:38.181227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 325/630] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:37 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1555 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:38.206611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:38.207196 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:38.214568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:38.214942 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:38.215703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:38.216224 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:38.239300 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:38.436767 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:38.458228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:38.462226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:38.464281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-631fcb46-1333-404c-8862-e44c1c49b7e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.260964 Jun 16 12:00:38.465577 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 306/631] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:38 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:39.114236 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5807fc9b-17db-4e68-9d78-ebe50d6a2885 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Action: 'create', calling method: .version_select at 0x7f433435cc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1800397449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBm5gOyH0kmn2zKGXRmwfHeRKefzLlEfhHyLJ+j8IwFnQXodQPWqlfMC8IqqzDbVHTvjafxxWVG7ctcKiiZ09AqrFKN0RNCs2iQABUFYQjE6zULM6s0P9GI5uUxe/26QFw=="}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:39.129555 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-5807fc9b-17db-4e68-9d78-ebe50d6a2885 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Getting quotas for project fab61ecc47674e6e961f67c0b412fda6. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:00:39.133308 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-5807fc9b-17db-4e68-9d78-ebe50d6a2885 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Getting quotas for user 6f81df1b996f4e6a808c83f4eebe586f and project fab61ecc47674e6e961f67c0b412fda6. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:00:39.197821 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-32056e9c-83ec-4f8b-8dc6-3429949b520e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:39.198984 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-32056e9c-83ec-4f8b-8dc6-3429949b520e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:39.204921 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32056e9c-83ec-4f8b-8dc6-3429949b520e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:39.205365 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32056e9c-83ec-4f8b-8dc6-3429949b520e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:39.206118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32056e9c-83ec-4f8b-8dc6-3429949b520e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:39.206546 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32056e9c-83ec-4f8b-8dc6-3429949b520e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:39.213268 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5807fc9b-17db-4e68-9d78-ebe50d6a2885 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.284438 Jun 16 12:00:39.214536 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 326/632] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 12:00:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:39.343466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-32056e9c-83ec-4f8b-8dc6-3429949b520e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:39.354884 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-32056e9c-83ec-4f8b-8dc6-3429949b520e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1555 microversion: 2.1 time: 0.160881 Jun 16 12:00:39.355458 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 307/633] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:39 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:39.482760 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:39.484111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:39.491586 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:39.492313 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:39.494001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:39.494560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:39.665137 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:39.680471 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:39.682780 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:39.691567 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-31f9912a-0f0c-446e-91ed-ecfa8819bc2d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.212463 Jun 16 12:00:39.692413 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 327/634] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:39 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:40.373022 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6f2ea76f-0edb-47d9-ab92-63833fac5b4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:40.374175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6f2ea76f-0edb-47d9-ab92-63833fac5b4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:40.382670 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6f2ea76f-0edb-47d9-ab92-63833fac5b4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:40.383353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6f2ea76f-0edb-47d9-ab92-63833fac5b4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:40.384241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6f2ea76f-0edb-47d9-ab92-63833fac5b4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:40.386945 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6f2ea76f-0edb-47d9-ab92-63833fac5b4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:40.648421 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-f3780e11-841b-44c8-a3c3-3429bf6b1f57 req-9f67ec5c-4af1-442e-babb-42e33b7d9025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e80655-be0f-41d4-98b2-feea6405ace6", "name": "network-vif-deleted", "tag": "615b821c-cb44-4dee-9938-fc6957f26847"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:40.662450 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-f3780e11-841b-44c8-a3c3-3429bf6b1f57 req-9f67ec5c-4af1-442e-babb-42e33b7d9025 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:40.662768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-f3780e11-841b-44c8-a3c3-3429bf6b1f57 req-9f67ec5c-4af1-442e-babb-42e33b7d9025 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:40.684313 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-f3780e11-841b-44c8-a3c3-3429bf6b1f57 req-9f67ec5c-4af1-442e-babb-42e33b7d9025 service nova] Creating event network-vif-deleted:615b821c-cb44-4dee-9938-fc6957f26847 for instance 67e80655-be0f-41d4-98b2-feea6405ace6 on hv-cinder-84614 Jun 16 12:00:40.712024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-f3780e11-841b-44c8-a3c3-3429bf6b1f57 req-9f67ec5c-4af1-442e-babb-42e33b7d9025 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067194 Jun 16 12:00:40.713692 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 328/635] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:00:40.726515 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:40.727793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:40.746684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6f2ea76f-0edb-47d9-ab92-63833fac5b4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:40.757082 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:40.757902 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:40.758321 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6f2ea76f-0edb-47d9-ab92-63833fac5b4e tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1555 microversion: 2.1 time: 0.389808 Jun 16 12:00:40.759229 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 308/636] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:40 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1555 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:40.760018 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:40.760511 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:40.765324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:40.933969 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:40.945248 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:40.947051 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:40.949783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ad7c389a-0667-47d5-b6a6-699f0dbde662 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1723 microversion: 2.20 time: 0.234894 Jun 16 12:00:40.950343 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 329/637] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:40 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:41.775678 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:41.777789 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:41.785014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:41.785702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:41.787609 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:41.788264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:41.836332 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:41.837713 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:41.838380 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lazy-loading 'fault' on Instance uuid 67e80655-be0f-41d4-98b2-feea6405ace6 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:00:41.897506 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6730f4274e240dd9da30e5c3bc3679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345dc1b6fec149e88f1be7837d126d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:41.910067 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9dd47c73-a865-42c6-948a-e331b01c2260 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 200 len: 1349 microversion: 2.1 time: 0.137149 Jun 16 12:00:41.924645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 309/638] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:41 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 1349 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:41.974039 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:41.975329 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:41.987654 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:41.988681 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:41.990096 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:41.990913 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:42.100908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:42.101690 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:42.102309 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lazy-loading 'fault' on Instance uuid 6646f09a-70e9-487b-98f0-89ab1fe5508a {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:00:42.160810 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:42.172293 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:42.174178 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:42.175611 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4cc95c97-6a11-466e-acc7-0eb4436b631f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 200 len: 1371 microversion: 2.20 time: 0.209658 Jun 16 12:00:42.176777 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 330/639] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:41 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:42.267136 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d54f8de8-158b-4fcc-b2ed-3bcc2924b0e8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:42.267931 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d54f8de8-158b-4fcc-b2ed-3bcc2924b0e8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:42.277777 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d54f8de8-158b-4fcc-b2ed-3bcc2924b0e8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:42.280359 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d54f8de8-158b-4fcc-b2ed-3bcc2924b0e8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:42.280359 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d54f8de8-158b-4fcc-b2ed-3bcc2924b0e8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:42.280359 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d54f8de8-158b-4fcc-b2ed-3bcc2924b0e8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:42.504500 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-d54f8de8-158b-4fcc-b2ed-3bcc2924b0e8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lazy-loading 'services' on Instance uuid 7ce66b98-0e9e-40cf-a971-f00cf0132326 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:00:42.752738 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-cab29342-c3a6-41fe-9bb9-b735463f2da7 req-ae881860-e865-4b93-84ba-8b7f8ca3f4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6646f09a-70e9-487b-98f0-89ab1fe5508a", "name": "network-vif-deleted", "tag": "e8a94066-1a49-45d0-9264-0c1a6dbdacde"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:42.774601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-cab29342-c3a6-41fe-9bb9-b735463f2da7 req-ae881860-e865-4b93-84ba-8b7f8ca3f4cd service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:42.775063 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-cab29342-c3a6-41fe-9bb9-b735463f2da7 req-ae881860-e865-4b93-84ba-8b7f8ca3f4cd service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:42.799433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-cab29342-c3a6-41fe-9bb9-b735463f2da7 req-ae881860-e865-4b93-84ba-8b7f8ca3f4cd service nova] Creating event network-vif-deleted:e8a94066-1a49-45d0-9264-0c1a6dbdacde for instance 6646f09a-70e9-487b-98f0-89ab1fe5508a on hv-cinder-84614 Jun 16 12:00:42.818523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d54f8de8-158b-4fcc-b2ed-3bcc2924b0e8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326/os-volume_attachments/d84767a2-f23e-4137-858b-fe12cd5544cc" status: 202 len: 0 microversion: 2.1 time: 0.555094 Jun 16 12:00:42.819675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 310/640] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:00:42 2022] DELETE /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326/os-volume_attachments/d84767a2-f23e-4137-858b-fe12cd5544cc => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:00:42.829367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-cab29342-c3a6-41fe-9bb9-b735463f2da7 req-ae881860-e865-4b93-84ba-8b7f8ca3f4cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074093 Jun 16 12:00:42.830446 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 331/641] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:00:42.949187 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:42.950192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] [instance: 67e80655-be0f-41d4-98b2-feea6405ace6] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:42.974243 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:42.974870 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:42.975996 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:42.976579 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:43.000022 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] HTTP exception thrown: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 could not be found. Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Request method failure captured: Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 HTTP/1.1 Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxqQBea-m6wtIVCgl5Pgi-rPytmampNylG4ihKw3OivcEB-po7bno-6OyaAnpxHTGZC5ZOzAcUxXTZcVg1Nd-jIHcmghq_d83pJ11BHtSEPOvc6mG1aRGNWMM3PfkP3rnSxwKxcOg3QpTIQyHj-7eidEqvUcr6uEiN7cZW8-Kbf2g5I Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 345dc1b6fec149e88f1be7837d126d20 Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-TestMinimumBasicScenario-1724049969 Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:00:43.002109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/345dc1b6fec149e88f1be7837d126d20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_345dc1b6fec149e88f1be7837d126d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/345dc1b6fec149e88f1be7837d126d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/345dc1b6fec149e88f1be7837d126d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-TestMinimumBasicScenario-1724049969 Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 345dc1b6fec149e88f1be7837d126d20 Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1724049969 Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-TestMinimumBasicScenario-1724049969-project Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: e6730f4274e240dd9da30e5c3bc3679b Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-TestMinimumBasicScenario-1724049969-project Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 could not be found. Jun 16 12:00:43.010950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '67e80655-be0f-41d4-98b2-feea6405ace6'} Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 could not be found. Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:00:43.011858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 could not be found. Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 could not be found. Jun 16 12:00:43.013509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.014786 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Returning 404 to user: Instance 67e80655-be0f-41d4-98b2-feea6405ace6 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:00:43.014786 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-aa6f68d8-9ccb-4204-a7df-bedeeb661d09 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6" status: 404 len: 111 microversion: 2.1 time: 0.075442 Jun 16 12:00:43.014786 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 311/642] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:42 2022] GET /compute/v2.1/servers/67e80655-be0f-41d4-98b2-feea6405ace6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:00:43.015010 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-502a1ecb-f10c-4a33-8f16-ef121ff1bb83 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] Calling method '.version_select at 0x7f433429a9d0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:43.123371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-502a1ecb-f10c-4a33-8f16-ef121ff1bb83 tempest-TestMinimumBasicScenario-1724049969 tempest-TestMinimumBasicScenario-1724049969-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1321410642" status: 202 len: 0 microversion: 2.1 time: 0.113629 Jun 16 12:00:43.124754 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 332/643] 10.222.0.40 () {58 vars in 1271 bytes} [Thu Jun 16 12:00:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1321410642 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:00:43.195894 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:43.195894 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:43.202465 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:43.203130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:43.204083 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:43.204663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:43.220135 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] HTTP exception thrown: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Request method failure captured: Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a HTTP/1.1 Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpedl4IEkehSq-0jGYd7TA-o3jsWNZrR022CMW_08cVOPb-eZoYkg1s8vhWNLZYOYtxbfknK4r7UbuZLU862LBz8ryUFDarBhDKGlP6dduyxLBUB2bbrQpjMiGP2EYYgftIbHCqaO1n6C1OyrjXRyR1s4nNShIuENAdHCRJBl6k7bc Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:00:43.221658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 97ce6d944eb74b9794d6d0d5f18d4bad Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:00:43.223294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '6646f09a-70e9-487b-98f0-89ab1fe5508a'} Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:00:43.224191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:00:43.225583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:43.227638 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Returning 404 to user: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:00:43.228766 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-cfd5786e-bd15-49bb-a34f-f302f9ada9d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 404 len: 111 microversion: 2.20 time: 0.038218 Jun 16 12:00:43.233005 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 312/644] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:43 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:00:43.238532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8e50e7d3-5ee4-4dbc-aa00-211654601352 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '.version_select at 0x7f43341133a0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:43.340686 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8e50e7d3-5ee4-4dbc-aa00-211654601352 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766578446" status: 204 len: 0 microversion: 2.20 time: 0.106197 Jun 16 12:00:43.341269 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 333/645] 10.222.0.40 () {60 vars in 1261 bytes} [Thu Jun 16 12:00:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766578446 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 12:00:44.324602 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-09296c2d-0aec-404c-a312-bea9fc177b4f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'create', calling method: .version_select at 0x7f433449d3a0>, body: {"keypair": {"name": "tempest-keypair-829723833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8VukY52y3FdxqAxpl3BiHpTwyVWMAPgezfbRdNihAcF66sTQ3C2b1CWVxlArKRA9oiQkUm/67QVvVAXFoTfENQ+d8Y1OSCFOmwuRkbnrRjFJB8eOAK7GhHyfMPlh7Yyg=="}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:44.342802 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-09296c2d-0aec-404c-a312-bea9fc177b4f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Getting quotas for project 659db25373614c8da6fc81e59ef9c6f6. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:00:44.347582 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-09296c2d-0aec-404c-a312-bea9fc177b4f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Getting quotas for user 97ce6d944eb74b9794d6d0d5f18d4bad and project 659db25373614c8da6fc81e59ef9c6f6. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:00:44.438128 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-09296c2d-0aec-404c-a312-bea9fc177b4f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.116907 Jun 16 12:00:44.440081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 313/646] 10.222.0.40 () {62 vars in 1199 bytes} [Thu Jun 16 12:00:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 12:00:45.044916 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e79f8375-c315-42e0-9888-ec117a6c2f3d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:45.045532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e79f8375-c315-42e0-9888-ec117a6c2f3d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:45.053905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e79f8375-c315-42e0-9888-ec117a6c2f3d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:45.054350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e79f8375-c315-42e0-9888-ec117a6c2f3d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:45.055123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e79f8375-c315-42e0-9888-ec117a6c2f3d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:45.055548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e79f8375-c315-42e0-9888-ec117a6c2f3d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:45.082338 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e79f8375-c315-42e0-9888-ec117a6c2f3d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:00:45.417163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e79f8375-c315-42e0-9888-ec117a6c2f3d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 204 len: 0 microversion: 2.1 time: 0.376581 Jun 16 12:00:45.417759 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 334/647] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:00:45 2022] DELETE /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:00:45.434174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d768f0c4-a26d-4e99-b074-1a4a1fe3ba4f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:45.434174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d768f0c4-a26d-4e99-b074-1a4a1fe3ba4f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:45.434764 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d768f0c4-a26d-4e99-b074-1a4a1fe3ba4f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:45.435142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d768f0c4-a26d-4e99-b074-1a4a1fe3ba4f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:45.436031 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d768f0c4-a26d-4e99-b074-1a4a1fe3ba4f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:45.436467 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d768f0c4-a26d-4e99-b074-1a4a1fe3ba4f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:45.593064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d768f0c4-a26d-4e99-b074-1a4a1fe3ba4f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:45.601201 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d768f0c4-a26d-4e99-b074-1a4a1fe3ba4f tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1513 microversion: 2.1 time: 0.178897 Jun 16 12:00:45.601767 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 314/648] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:45 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:46.619201 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8dcc3fc4-aeda-41a7-a39e-05799198e0b5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:46.622080 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8dcc3fc4-aeda-41a7-a39e-05799198e0b5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:46.626324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8dcc3fc4-aeda-41a7-a39e-05799198e0b5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:46.626769 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8dcc3fc4-aeda-41a7-a39e-05799198e0b5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:46.627574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8dcc3fc4-aeda-41a7-a39e-05799198e0b5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:46.628038 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8dcc3fc4-aeda-41a7-a39e-05799198e0b5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:46.908636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8dcc3fc4-aeda-41a7-a39e-05799198e0b5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:46.920710 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8dcc3fc4-aeda-41a7-a39e-05799198e0b5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1513 microversion: 2.1 time: 0.305466 Jun 16 12:00:46.923111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 335/649] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:46 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:00:47.564585 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1507153443", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6088f5f2-7ffc-4d4b-af08-9c80eec0b3aa"}], "security_groups": [{"name": "tempest-securitygroup--1216890814"}], "key_name": "tempest-keypair-829723833", "user_data": "}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:47.872575 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] validate_networks() for [('6088f5f2-7ffc-4d4b-af08-9c80eec0b3aa', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:00:47.939125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f8126a6c-24e1-4572-8734-1c87004d384d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:47.939730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f8126a6c-24e1-4572-8734-1c87004d384d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:47.945941 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8126a6c-24e1-4572-8734-1c87004d384d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:47.946485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8126a6c-24e1-4572-8734-1c87004d384d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:47.947175 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8126a6c-24e1-4572-8734-1c87004d384d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:47.947604 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8126a6c-24e1-4572-8734-1c87004d384d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:48.093957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f8126a6c-24e1-4572-8734-1c87004d384d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:48.102185 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f8126a6c-24e1-4572-8734-1c87004d384d tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1513 microversion: 2.1 time: 0.166958 Jun 16 12:00:48.108970 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 336/650] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:47 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:48.767017 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:00:48.767523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:00:48.768133 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:00:48.768634 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:00:48.769410 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:00:48.779916 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:48.780445 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:48.781382 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:48.781902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:48.806696 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-36759c8d-470f-4b21-b984-ef352ca4eb86 req-fa941beb-0e36-4b3d-b303-8d6f9c34e202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce66b98-0e9e-40cf-a971-f00cf0132326", "name": "network-vif-deleted", "tag": "d06f37d1-57c7-48f9-a3c7-1e29dd3fe530"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:48.806867 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Getting quotas for project 659db25373614c8da6fc81e59ef9c6f6. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:00:48.813521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Getting quotas for user 97ce6d944eb74b9794d6d0d5f18d4bad and project 659db25373614c8da6fc81e59ef9c6f6. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:00:48.822714 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-36759c8d-470f-4b21-b984-ef352ca4eb86 req-fa941beb-0e36-4b3d-b303-8d6f9c34e202 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:48.823165 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-36759c8d-470f-4b21-b984-ef352ca4eb86 req-fa941beb-0e36-4b3d-b303-8d6f9c34e202 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:48.826065 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:00:48.836354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-36759c8d-470f-4b21-b984-ef352ca4eb86 req-fa941beb-0e36-4b3d-b303-8d6f9c34e202 service nova] Creating event network-vif-deleted:d06f37d1-57c7-48f9-a3c7-1e29dd3fe530 for instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 on hv-cinder-84614 Jun 16 12:00:48.838311 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:00:48.842280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-36759c8d-470f-4b21-b984-ef352ca4eb86 req-fa941beb-0e36-4b3d-b303-8d6f9c34e202 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040893 Jun 16 12:00:48.843023 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 337/651] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:48.978299 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a775cdef-8946-4437-adaf-eb508be59df9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.419140 Jun 16 12:00:48.981007 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 315/652] 10.222.0.40 () {62 vars in 1187 bytes} [Thu Jun 16 12:00:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 12:00:48.991059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0f4712a1-567c-4154-b8b0-b64d80752659 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:48.992686 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0f4712a1-567c-4154-b8b0-b64d80752659 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:49.089951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0f4712a1-567c-4154-b8b0-b64d80752659 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:49.098627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0f4712a1-567c-4154-b8b0-b64d80752659 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:49.111806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0f4712a1-567c-4154-b8b0-b64d80752659 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:49.113529 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0f4712a1-567c-4154-b8b0-b64d80752659 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1281 microversion: 2.20 time: 0.127657 Jun 16 12:00:49.126165 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 338/653] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:48 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:49.133217 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:49.133217 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:49.141757 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:49.142204 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:49.143526 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:49.144223 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:49.211750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:49.212413 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:49.212791 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lazy-loading 'fault' on Instance uuid 7ce66b98-0e9e-40cf-a971-f00cf0132326 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:00:49.272112 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:49.286021 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d599f64d-901b-4994-bffb-90564290818e tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 200 len: 1308 microversion: 2.1 time: 0.169501 Jun 16 12:00:49.287061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 316/654] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:49 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:00:50.132371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:50.132948 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:50.140242 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:50.140940 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:50.141859 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:50.142485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:50.211066 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:50.221507 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:50.223685 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:50.225024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-70d3dc69-ad4c-414b-919c-9df82068e16b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1285 microversion: 2.20 time: 0.096617 Jun 16 12:00:50.235520 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 339/655] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:50 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:50.308207 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:50.309118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 7ce66b98-0e9e-40cf-a971-f00cf0132326] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:50.321787 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:50.322331 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:50.323282 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:50.323804 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:50.338779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] HTTP exception thrown: Instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 could not be found. Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Request method failure captured: Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 HTTP/1.1 Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxsmQFqHn3AA8eR6ae1dcpMAcDJGtNQ38SHlH5x0Xm_wPzgqXiazC1Fgmwd923bPj24wbtU0ECrU4qodEeVV4ZUvx7g9eLc-DgQ5U5u_8b_fUOQzBcwT5nIjgZf6re5jr9pVcRbHZgIU1lxr2q4h3f3R3UhG1SQK5bvHVab8QuJaTgQ Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 82c80e6e109741d1bd83c7b81368a87f Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesSnapshotTestJSON-177579902 Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:00:50.340587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/82c80e6e109741d1bd83c7b81368a87f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_82c80e6e109741d1bd83c7b81368a87f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82c80e6e109741d1bd83c7b81368a87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82c80e6e109741d1bd83c7b81368a87f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesSnapshotTestJSON-177579902 Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 82c80e6e109741d1bd83c7b81368a87f Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-177579902 Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesSnapshotTestJSON-177579902-project Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 5e69fc12fcc34fa39f67dd156cd860a4 Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesSnapshotTestJSON-177579902-project Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 could not be found. Jun 16 12:00:50.341929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '7ce66b98-0e9e-40cf-a971-f00cf0132326'} Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 could not be found. Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:00:50.342737 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 could not be found. Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 could not be found. Jun 16 12:00:50.344281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:00:50.345819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Returning 404 to user: Instance 7ce66b98-0e9e-40cf-a971-f00cf0132326 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:00:50.345819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6d485664-fc2f-4ce9-8bcd-53ba44b17b12 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326" status: 404 len: 111 microversion: 2.1 time: 0.038695 Jun 16 12:00:50.345819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 317/656] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:00:50 2022] GET /compute/v2.1/servers/7ce66b98-0e9e-40cf-a971-f00cf0132326 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:00:51.243964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:51.244553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:51.252045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:51.252617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:51.253548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:51.254128 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:51.351444 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:51.359354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:51.360911 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:51.361989 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ce5a1e53-2753-429d-bac1-9590f698ccaf tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1351 microversion: 2.20 time: 0.122833 Jun 16 12:00:51.362552 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 340/657] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:51 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:52.380972 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:52.381610 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:52.388235 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:52.388856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:52.392416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:52.392416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:52.459479 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:52.468378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:52.469892 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:52.471237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-aa18d890-3078-41b3-862f-09c0501a4308 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1339 microversion: 2.20 time: 0.094556 Jun 16 12:00:52.471784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 318/658] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:52 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:53.489984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:53.490678 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:53.498233 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:53.498950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:53.499748 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:53.500232 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:53.566763 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:53.575675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:53.577378 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:53.578611 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-03b73ff3-0e97-4e6b-851d-1c7ff602e0d7 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1339 microversion: 2.20 time: 0.093010 Jun 16 12:00:53.584364 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 341/659] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:53 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:54.597604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:54.603648 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:54.607771 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:54.608446 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:54.609248 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:54.610132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:54.809960 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:54.818538 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:54.821979 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:54.821979 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7eac5adb-6b1d-4c6b-a9c7-f6ba67cbbdd6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.227978 Jun 16 12:00:54.822190 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 319/660] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:54 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:55.602010 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-71611733-d558-42e8-9bc3-2ee0812d793f req-12ba77e7-86ca-4f61-b33e-22271de9727b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92dcff2-3f99-42cc-ba24-52bc94d88986", "tag": "7a3bc920-a057-45f1-b3ee-bc1f2c74986b"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:00:55.612971 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-71611733-d558-42e8-9bc3-2ee0812d793f req-12ba77e7-86ca-4f61-b33e-22271de9727b service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:55.613616 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-71611733-d558-42e8-9bc3-2ee0812d793f req-12ba77e7-86ca-4f61-b33e-22271de9727b service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:55.627076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-71611733-d558-42e8-9bc3-2ee0812d793f req-12ba77e7-86ca-4f61-b33e-22271de9727b service nova] Creating event network-changed:7a3bc920-a057-45f1-b3ee-bc1f2c74986b for instance f92dcff2-3f99-42cc-ba24-52bc94d88986 on hv-cinder-84614 Jun 16 12:00:55.633072 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-71611733-d558-42e8-9bc3-2ee0812d793f req-12ba77e7-86ca-4f61-b33e-22271de9727b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034464 Jun 16 12:00:55.634177 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 342/661] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:00:55.838571 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:55.840653 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:55.849512 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:55.850221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:55.851196 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:55.852340 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:56.020449 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:56.030363 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:56.031857 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:56.033008 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-771faddd-1288-4908-9177-9c4c41169ef2 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.198326 Jun 16 12:00:56.033734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 320/662] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:55 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:57.051303 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:57.052020 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:57.058207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:57.058652 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:57.059537 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:57.059997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:57.266172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:57.274273 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:57.275811 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:57.277719 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5e89bcdc-49ce-4211-8bf3-0e5b85c1a112 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.230938 Jun 16 12:00:57.278260 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 343/663] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:57 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:58.295566 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:58.296251 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:58.302661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:58.303099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:58.303902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:58.304324 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:58.656970 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:58.665259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:58.675846 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:58.675846 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-81af9e93-8d78-45bb-aec4-4a55447615e1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.377418 Jun 16 12:00:58.675846 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 321/664] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:58 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:00:59.686849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:00:59.687447 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:00:59.690296 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=6 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:59.690645 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:59.695304 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:59.695741 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:59.696532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:00:59.696957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:00:59.896044 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:59.904585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:59.906092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:00:59.907219 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a6929390-0967-403f-b5f3-9e5672b04c48 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.224482 Jun 16 12:00:59.907903 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 344/665] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:00:59 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:01:00.917702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1295929212", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "networks": [{"uuid": "f18477c1-13d7-45f2-9ae2-cf7317fba9fc"}]}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:00.928774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:00.930145 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:00.931604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:00.933090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=10 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:00.952000 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:00.953873 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:00.960532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:00.961716 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:00.987352 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] validate_networks() for [('f18477c1-13d7-45f2-9ae2-cf7317fba9fc', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:01:01.133923 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:01.143049 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:01.144599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:01.146279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d91ecbb6-085e-4a93-af8b-9cf49961d211 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.223555 Jun 16 12:01:01.146846 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 345/666] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:01:00 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:01:01.613935 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:01:01.614119 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:01:01.614537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:01:01.614945 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:01:01.615349 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:01:01.625559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:01.626293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:01.627469 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:01.628107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:01.646740 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Getting quotas for project 82c80e6e109741d1bd83c7b81368a87f. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:01:01.651213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Getting quotas for user 5e69fc12fcc34fa39f67dd156cd860a4 and project 82c80e6e109741d1bd83c7b81368a87f. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:01:01.663760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:01:01.666020 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:01:01.815611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-04963c51-8efa-4d2e-96e3-b8dd7f6c63ce tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903366 Jun 16 12:01:01.817364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 322/667] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:01:01.827152 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8698a15f-e1f9-4667-acb3-ea3c5fe0c6ff tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:01.827767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8698a15f-e1f9-4667-acb3-ea3c5fe0c6ff tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:01.921894 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8698a15f-e1f9-4667-acb3-ea3c5fe0c6ff tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:01.930282 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8698a15f-e1f9-4667-acb3-ea3c5fe0c6ff tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1219 microversion: 2.1 time: 0.106030 Jun 16 12:01:01.933984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 346/668] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:01 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:02.167547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:02.172981 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:02.180271 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:02.180719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:02.181591 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:02.182028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:02.354244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:02.371089 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:02.371089 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:02.371089 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-380a02cf-f24c-4e6a-a294-817c3c9d6f43 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.207016 Jun 16 12:01:02.371330 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 323/669] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:01:02 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:01:02.598909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-894954420", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1800397449", "security_groups": [{"name": "tempest-secgroup-smoke-835510752"}], "networks": [{"uuid": "a1ed814f-8263-4998-9e1f-5b17d8b2bfc5"}], "block_device_mapping_v2": [{"uuid": "3d06340c-556e-467a-a262-d46f0c55ee25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:02.741849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] validate_networks() for [('a1ed814f-8263-4998-9e1f-5b17d8b2bfc5', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:01:02.950218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e9c43ffa-85fe-4c4a-9ed6-35289a03ae96 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:02.951076 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e9c43ffa-85fe-4c4a-9ed6-35289a03ae96 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:02.957829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9c43ffa-85fe-4c4a-9ed6-35289a03ae96 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:02.958695 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9c43ffa-85fe-4c4a-9ed6-35289a03ae96 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:02.959702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9c43ffa-85fe-4c4a-9ed6-35289a03ae96 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:02.960160 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e9c43ffa-85fe-4c4a-9ed6-35289a03ae96 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:03.038379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e9c43ffa-85fe-4c4a-9ed6-35289a03ae96 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:03.045520 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e9c43ffa-85fe-4c4a-9ed6-35289a03ae96 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1223 microversion: 2.1 time: 0.099918 Jun 16 12:01:03.046108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 324/670] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:02 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:03.176040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:01:03.177454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:01:03.178166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:01:03.178788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:01:03.179531 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:01:03.194118 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:03.194946 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:03.196619 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:03.197197 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:03.224339 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Getting quotas for project fab61ecc47674e6e961f67c0b412fda6. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:01:03.229191 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Getting quotas for user 6f81df1b996f4e6a808c83f4eebe586f and project fab61ecc47674e6e961f67c0b412fda6. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:01:03.291998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:01:03.294265 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d06340c-556e-467a-a262-d46f0c55ee25',volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:01:03.388823 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:03.389432 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:03.396539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:03.396980 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:03.397750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:03.398230 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:03.566349 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:03.575096 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:03.576720 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:03.577829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-53475d4f-03b5-4af0-8818-e6d1e42bf156 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.193754 Jun 16 12:01:03.578391 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 325/671] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:01:03 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:01:03.754517 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-50506404-b2a3-4f4a-938c-ec2c10a64da7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.159761 Jun 16 12:01:03.768274 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cb4c911e-6881-4aa7-91cd-89118f5f8471 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:03.768729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 347/672] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:01:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:01:03.768885 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-cb4c911e-6881-4aa7-91cd-89118f5f8471 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:03.878121 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-cb4c911e-6881-4aa7-91cd-89118f5f8471 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:03.886898 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-cb4c911e-6881-4aa7-91cd-89118f5f8471 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1088 microversion: 2.1 time: 0.121846 Jun 16 12:01:03.887393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 326/673] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:03 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1088 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:03.966967 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4270d76b-03fd-4560-85b5-69b56ede9c07 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:03.968074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4270d76b-03fd-4560-85b5-69b56ede9c07 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:03.974644 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4270d76b-03fd-4560-85b5-69b56ede9c07 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:03.975091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4270d76b-03fd-4560-85b5-69b56ede9c07 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:03.975962 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4270d76b-03fd-4560-85b5-69b56ede9c07 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:03.976360 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4270d76b-03fd-4560-85b5-69b56ede9c07 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.012401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4270d76b-03fd-4560-85b5-69b56ede9c07 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049802 Jun 16 12:01:04.013190 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 348/674] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:01:03 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:01:04.062768 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f1171c32-0174-40a8-ac98-fc1c53fd236b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:04.063302 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f1171c32-0174-40a8-ac98-fc1c53fd236b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:04.071372 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f1171c32-0174-40a8-ac98-fc1c53fd236b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.076305 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f1171c32-0174-40a8-ac98-fc1c53fd236b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.077172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f1171c32-0174-40a8-ac98-fc1c53fd236b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.077616 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f1171c32-0174-40a8-ac98-fc1c53fd236b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.088551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:04.133208 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ed470427-2518-4a45-8391-60461adcbce1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:04.134012 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ed470427-2518-4a45-8391-60461adcbce1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:04.143377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ed470427-2518-4a45-8391-60461adcbce1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.146073 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ed470427-2518-4a45-8391-60461adcbce1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.147237 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ed470427-2518-4a45-8391-60461adcbce1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.147848 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ed470427-2518-4a45-8391-60461adcbce1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.194045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ed470427-2518-4a45-8391-60461adcbce1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:01:04.276153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:04.494246 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f1171c32-0174-40a8-ac98-fc1c53fd236b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:04.507991 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f1171c32-0174-40a8-ac98-fc1c53fd236b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1279 microversion: 2.1 time: 0.449004 Jun 16 12:01:04.519539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 327/675] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:04 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1279 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:04.524795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-5200aa06-e16b-4186-abbd-f0f4075075dc req-732de370-0487-4ef9-9065-1d69e50270be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92dcff2-3f99-42cc-ba24-52bc94d88986", "name": "network-vif-plugged", "status": "completed", "tag": "7a3bc920-a057-45f1-b3ee-bc1f2c74986b"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:04.534803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-5200aa06-e16b-4186-abbd-f0f4075075dc req-732de370-0487-4ef9-9065-1d69e50270be service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.535226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-5200aa06-e16b-4186-abbd-f0f4075075dc req-732de370-0487-4ef9-9065-1d69e50270be service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.549738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-5200aa06-e16b-4186-abbd-f0f4075075dc req-732de370-0487-4ef9-9065-1d69e50270be service nova] Creating event network-vif-plugged:7a3bc920-a057-45f1-b3ee-bc1f2c74986b for instance f92dcff2-3f99-42cc-ba24-52bc94d88986 on hv-cinder-84614 Jun 16 12:01:04.568122 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-5200aa06-e16b-4186-abbd-f0f4075075dc req-732de370-0487-4ef9-9065-1d69e50270be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046872 Jun 16 12:01:04.568673 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 328/676] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:04.602015 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:04.609037 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:04.618500 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.619185 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.631952 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.634605 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.755774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ed470427-2518-4a45-8391-60461adcbce1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 204 len: 0 microversion: 2.1 time: 0.626498 Jun 16 12:01:04.759447 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 349/677] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:01:04 2022] DELETE /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 12:01:04.770452 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e6a7ac27-364d-4468-af63-50679cd06f9d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:04.771151 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e6a7ac27-364d-4468-af63-50679cd06f9d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:04.777506 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6a7ac27-364d-4468-af63-50679cd06f9d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.779974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6a7ac27-364d-4468-af63-50679cd06f9d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.779974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6a7ac27-364d-4468-af63-50679cd06f9d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:04.779974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6a7ac27-364d-4468-af63-50679cd06f9d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:04.836411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:04.846084 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:04.851227 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:04.851227 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9edc370b-1b79-496c-ac7c-8601f1f2c0ee tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.256798 Jun 16 12:01:04.851227 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 329/678] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:01:04 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:01:04.903801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a57e72e0-43a0-4bec-b774-40649e0421d6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:04.908781 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a57e72e0-43a0-4bec-b774-40649e0421d6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:04.912795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:04.972008 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a57e72e0-43a0-4bec-b774-40649e0421d6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:04.983366 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a57e72e0-43a0-4bec-b774-40649e0421d6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1088 microversion: 2.1 time: 0.083829 Jun 16 12:01:04.994178 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 330/679] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:04 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:05.248119 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e6a7ac27-364d-4468-af63-50679cd06f9d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:05.257900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e6a7ac27-364d-4468-af63-50679cd06f9d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1676 microversion: 2.1 time: 0.496824 Jun 16 12:01:05.259212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 350/680] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:04 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1676 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:05.525578 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-18fc7df7-86a9-4804-98d4-437bbba5b0c5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:05.526224 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-18fc7df7-86a9-4804-98d4-437bbba5b0c5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:05.534323 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-18fc7df7-86a9-4804-98d4-437bbba5b0c5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:05.535025 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-18fc7df7-86a9-4804-98d4-437bbba5b0c5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:05.536016 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-18fc7df7-86a9-4804-98d4-437bbba5b0c5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:05.536448 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-18fc7df7-86a9-4804-98d4-437bbba5b0c5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:05.675455 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-18fc7df7-86a9-4804-98d4-437bbba5b0c5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:05.686229 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-18fc7df7-86a9-4804-98d4-437bbba5b0c5 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.164243 Jun 16 12:01:05.687476 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 331/681] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:05 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:05.869089 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:05.870054 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:05.877831 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:05.878278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:05.879184 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:05.879620 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:06.001565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-713667bd-c757-4c4e-a2f6-118e462328be tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:06.002565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-713667bd-c757-4c4e-a2f6-118e462328be tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:06.013033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-713667bd-c757-4c4e-a2f6-118e462328be tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:06.015821 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-713667bd-c757-4c4e-a2f6-118e462328be tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:06.018141 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-713667bd-c757-4c4e-a2f6-118e462328be tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:06.019340 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-713667bd-c757-4c4e-a2f6-118e462328be tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:06.071553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:06.080998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:06.084072 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:06.085907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-eb93430a-55ad-4ec9-beb2-3d345f530da5 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.220453 Jun 16 12:01:06.086845 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 351/682] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:01:05 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:01:06.092574 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-713667bd-c757-4c4e-a2f6-118e462328be tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:06.101180 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-713667bd-c757-4c4e-a2f6-118e462328be tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1138 microversion: 2.1 time: 0.104566 Jun 16 12:01:06.102026 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 332/683] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:05 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1138 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:06.277905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-76d997a9-ca46-4d8c-8618-2781a70f3697 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:06.283222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-76d997a9-ca46-4d8c-8618-2781a70f3697 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:06.287386 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-76d997a9-ca46-4d8c-8618-2781a70f3697 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:06.287829 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-76d997a9-ca46-4d8c-8618-2781a70f3697 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:06.288819 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-76d997a9-ca46-4d8c-8618-2781a70f3697 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:06.289235 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-76d997a9-ca46-4d8c-8618-2781a70f3697 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:06.703387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-88e45026-e74c-4e8c-a13f-ec7d941826d9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:06.706043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-88e45026-e74c-4e8c-a13f-ec7d941826d9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:06.722059 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-88e45026-e74c-4e8c-a13f-ec7d941826d9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:06.732978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-88e45026-e74c-4e8c-a13f-ec7d941826d9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:06.734044 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-88e45026-e74c-4e8c-a13f-ec7d941826d9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:06.734487 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-88e45026-e74c-4e8c-a13f-ec7d941826d9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:06.852386 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-76d997a9-ca46-4d8c-8618-2781a70f3697 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:06.867639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-76d997a9-ca46-4d8c-8618-2781a70f3697 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1676 microversion: 2.1 time: 0.595320 Jun 16 12:01:06.869085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 352/684] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:06 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1676 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:07.107807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:07.108787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:07.115774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:07.117007 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:07.120840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:07.121482 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:07.263168 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-88e45026-e74c-4e8c-a13f-ec7d941826d9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:07.274834 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-88e45026-e74c-4e8c-a13f-ec7d941826d9 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.575446 Jun 16 12:01:07.275983 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 333/685] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:06 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:07.288058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a880c2aa-a0d7-4220-a9fe-185f80f27a7a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:07.288930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a880c2aa-a0d7-4220-a9fe-185f80f27a7a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:07.302554 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a880c2aa-a0d7-4220-a9fe-185f80f27a7a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:07.302914 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a880c2aa-a0d7-4220-a9fe-185f80f27a7a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:07.303922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a880c2aa-a0d7-4220-a9fe-185f80f27a7a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:07.308921 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a880c2aa-a0d7-4220-a9fe-185f80f27a7a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:07.397878 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:07.409689 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:07.414346 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:07.415969 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4979282c-c003-4a87-8783-dec97d24d274 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.312740 Jun 16 12:01:07.418103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 353/686] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:01:07 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:01:07.471990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a880c2aa-a0d7-4220-a9fe-185f80f27a7a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:07.480657 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a880c2aa-a0d7-4220-a9fe-185f80f27a7a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1186 microversion: 2.1 time: 0.202096 Jun 16 12:01:07.490688 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 334/687] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:07 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1186 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:07.887608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-590acf8f-39a9-477e-8743-8895a7ac6c32 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:07.888386 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-590acf8f-39a9-477e-8743-8895a7ac6c32 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:07.894650 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-590acf8f-39a9-477e-8743-8895a7ac6c32 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:07.901608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-590acf8f-39a9-477e-8743-8895a7ac6c32 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:07.901608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-590acf8f-39a9-477e-8743-8895a7ac6c32 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:07.902435 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-590acf8f-39a9-477e-8743-8895a7ac6c32 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:08.088200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-590acf8f-39a9-477e-8743-8895a7ac6c32 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:08.100008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-590acf8f-39a9-477e-8743-8895a7ac6c32 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1676 microversion: 2.1 time: 0.217304 Jun 16 12:01:08.101233 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 354/688] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:07 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:08.304039 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-38c691ed-9dab-4835-9456-b9fd841cfdc3 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:08.305932 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-38c691ed-9dab-4835-9456-b9fd841cfdc3 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:08.333052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-38c691ed-9dab-4835-9456-b9fd841cfdc3 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:08.337169 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-38c691ed-9dab-4835-9456-b9fd841cfdc3 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:08.339303 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-38c691ed-9dab-4835-9456-b9fd841cfdc3 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:08.341537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-38c691ed-9dab-4835-9456-b9fd841cfdc3 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:08.436530 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:08.437120 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:08.449162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:08.450505 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:08.451576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:08.452313 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:08.741636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:08.752178 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:08.752655 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:08.753784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4d670eb8-c111-4415-bd38-ad6dfff62753 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1407 microversion: 2.20 time: 0.322889 Jun 16 12:01:08.765109 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 355/689] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:01:08 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:01:08.765109 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0f28c4ea-0d65-4761-9999-fd014734a692 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:08.765109 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0f28c4ea-0d65-4761-9999-fd014734a692 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:08.779794 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f28c4ea-0d65-4761-9999-fd014734a692 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:08.786279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f28c4ea-0d65-4761-9999-fd014734a692 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:08.786279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f28c4ea-0d65-4761-9999-fd014734a692 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:08.786279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0f28c4ea-0d65-4761-9999-fd014734a692 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:08.919640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0f28c4ea-0d65-4761-9999-fd014734a692 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:08.930788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0f28c4ea-0d65-4761-9999-fd014734a692 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1204 microversion: 2.1 time: 0.172154 Jun 16 12:01:08.942987 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 356/690] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:08 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1204 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:09.050155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-8882003d-08b9-4b7f-a0c5-d5b7cc01a713 req-61c85621-4f39-432b-b637-7ebd0724c4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd54546-c04b-4baa-be84-8b3db4c724fc", "tag": "bb4fb330-aa18-4a4a-8209-5d2e1df86614"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:09.064585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-8882003d-08b9-4b7f-a0c5-d5b7cc01a713 req-61c85621-4f39-432b-b637-7ebd0724c4b3 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:09.065031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-8882003d-08b9-4b7f-a0c5-d5b7cc01a713 req-61c85621-4f39-432b-b637-7ebd0724c4b3 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:09.077448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-8882003d-08b9-4b7f-a0c5-d5b7cc01a713 req-61c85621-4f39-432b-b637-7ebd0724c4b3 service nova] Creating event network-changed:bb4fb330-aa18-4a4a-8209-5d2e1df86614 for instance 0fd54546-c04b-4baa-be84-8b3db4c724fc on hv-cinder-84614 Jun 16 12:01:09.082354 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-8882003d-08b9-4b7f-a0c5-d5b7cc01a713 req-61c85621-4f39-432b-b637-7ebd0724c4b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038734 Jun 16 12:01:09.083025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 357/691] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:01:09.119546 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b2771ec3-21fd-4fec-a1d5-6c5544d2da5c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:09.120830 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b2771ec3-21fd-4fec-a1d5-6c5544d2da5c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:09.127188 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b2771ec3-21fd-4fec-a1d5-6c5544d2da5c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:09.127644 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b2771ec3-21fd-4fec-a1d5-6c5544d2da5c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:09.128485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b2771ec3-21fd-4fec-a1d5-6c5544d2da5c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:09.128921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b2771ec3-21fd-4fec-a1d5-6c5544d2da5c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:09.259327 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b2771ec3-21fd-4fec-a1d5-6c5544d2da5c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:09.269155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b2771ec3-21fd-4fec-a1d5-6c5544d2da5c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1608 microversion: 2.1 time: 0.153133 Jun 16 12:01:09.270048 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 358/692] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:09 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1608 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:09.404158 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-38c691ed-9dab-4835-9456-b9fd841cfdc3 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:09.415762 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-38c691ed-9dab-4835-9456-b9fd841cfdc3 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 1.121755 Jun 16 12:01:09.427192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 335/693] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:08 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:09.774550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:09.775155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:09.785780 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:09.786231 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:09.787049 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:09.787444 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:09.953941 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0f33269d-d5da-4ea3-81d5-64aebe299bf6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:09.954618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0f33269d-d5da-4ea3-81d5-64aebe299bf6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:09.978498 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0f33269d-d5da-4ea3-81d5-64aebe299bf6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:09.978950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0f33269d-d5da-4ea3-81d5-64aebe299bf6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:09.983448 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0f33269d-d5da-4ea3-81d5-64aebe299bf6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:09.984415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0f33269d-d5da-4ea3-81d5-64aebe299bf6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.157033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:10.169087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:10.172366 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:10.174499 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5cb65d7d-13dd-4cbb-b547-add3a561f10d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1599 microversion: 2.20 time: 0.403853 Jun 16 12:01:10.188367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 359/694] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:01:09 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1599 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:01:10.194049 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8b6f1e9e-d15b-4c43-b1e3-c62cbbdc78de tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:10.194701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8b6f1e9e-d15b-4c43-b1e3-c62cbbdc78de tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:10.209218 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8b6f1e9e-d15b-4c43-b1e3-c62cbbdc78de tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:10.210174 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8b6f1e9e-d15b-4c43-b1e3-c62cbbdc78de tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.210979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8b6f1e9e-d15b-4c43-b1e3-c62cbbdc78de tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:10.211421 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8b6f1e9e-d15b-4c43-b1e3-c62cbbdc78de tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.405680 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0f33269d-d5da-4ea3-81d5-64aebe299bf6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:10.420529 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0f33269d-d5da-4ea3-81d5-64aebe299bf6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1271 microversion: 2.1 time: 0.474791 Jun 16 12:01:10.428844 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 336/695] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:09 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1271 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:10.436678 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f4a88df0-4c0d-4772-8c66-8f56145c1208 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:10.446535 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f4a88df0-4c0d-4772-8c66-8f56145c1208 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:10.463208 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4a88df0-4c0d-4772-8c66-8f56145c1208 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:10.463980 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4a88df0-4c0d-4772-8c66-8f56145c1208 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.464911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4a88df0-4c0d-4772-8c66-8f56145c1208 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:10.466072 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f4a88df0-4c0d-4772-8c66-8f56145c1208 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.537867 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8b6f1e9e-d15b-4c43-b1e3-c62cbbdc78de tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.348129 Jun 16 12:01:10.538752 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 360/696] 10.222.0.40 () {60 vars in 1315 bytes} [Thu Jun 16 12:01:10 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/os-interface => generated 285 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 12:01:10.546825 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-448dfb1f-940d-4c72-805d-8d304490c763 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:10.547324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-448dfb1f-940d-4c72-805d-8d304490c763 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:10.554468 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-448dfb1f-940d-4c72-805d-8d304490c763 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:10.554909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-448dfb1f-940d-4c72-805d-8d304490c763 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.555678 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-448dfb1f-940d-4c72-805d-8d304490c763 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:10.556488 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-448dfb1f-940d-4c72-805d-8d304490c763 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.611707 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f4a88df0-4c0d-4772-8c66-8f56145c1208 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:10.622558 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f4a88df0-4c0d-4772-8c66-8f56145c1208 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1323 microversion: 2.1 time: 0.192189 Jun 16 12:01:10.623728 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 337/697] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:10 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:10.630951 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1910cc51-8e28-44a5-b441-4addb9ca6515 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:10.631906 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1910cc51-8e28-44a5-b441-4addb9ca6515 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:10.642247 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1910cc51-8e28-44a5-b441-4addb9ca6515 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:10.642760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1910cc51-8e28-44a5-b441-4addb9ca6515 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.643542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1910cc51-8e28-44a5-b441-4addb9ca6515 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:10.644011 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1910cc51-8e28-44a5-b441-4addb9ca6515 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:10.689361 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-448dfb1f-940d-4c72-805d-8d304490c763 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'services' on Instance uuid 5c202b5a-d86c-445a-9119-9b0893b15c1f {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:11.047262 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-448dfb1f-940d-4c72-805d-8d304490c763 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments/9465cb0d-5830-441c-a73a-1a6f899ef823" status: 202 len: 0 microversion: 2.1 time: 0.506984 Jun 16 12:01:11.047891 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 361/698] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:01:10 2022] DELETE /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments/9465cb0d-5830-441c-a73a-1a6f899ef823 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:01:11.069944 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5d570486-5400-46c8-b92f-c6107bde0b7b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:11.071111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5d570486-5400-46c8-b92f-c6107bde0b7b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:11.090068 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1910cc51-8e28-44a5-b441-4addb9ca6515 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:11.091838 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5d570486-5400-46c8-b92f-c6107bde0b7b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:11.094551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5d570486-5400-46c8-b92f-c6107bde0b7b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:11.095694 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5d570486-5400-46c8-b92f-c6107bde0b7b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:11.098457 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5d570486-5400-46c8-b92f-c6107bde0b7b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:11.100972 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1910cc51-8e28-44a5-b441-4addb9ca6515 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.475965 Jun 16 12:01:11.101564 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 338/699] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:10 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:11.175238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5d570486-5400-46c8-b92f-c6107bde0b7b tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122710 Jun 16 12:01:11.176127 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 362/700] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:01:11 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:11.183596 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-e0b5f408-5b38-4319-a068-b8c8284ef27e req-d18d4467-a8e7-43b5-9691-513bc415ae29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd786b9e-48e7-4695-8549-aeabb6511e72", "name": "network-vif-deleted", "tag": "ebc45963-7af0-458c-bad2-2f2724cd51e0"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:11.200714 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-e0b5f408-5b38-4319-a068-b8c8284ef27e req-d18d4467-a8e7-43b5-9691-513bc415ae29 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:11.211460 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-e0b5f408-5b38-4319-a068-b8c8284ef27e req-d18d4467-a8e7-43b5-9691-513bc415ae29 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:11.247792 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-e0b5f408-5b38-4319-a068-b8c8284ef27e req-d18d4467-a8e7-43b5-9691-513bc415ae29 service nova] Creating event network-vif-deleted:ebc45963-7af0-458c-bad2-2f2724cd51e0 for instance bd786b9e-48e7-4695-8549-aeabb6511e72 on hv-cinder-84614 Jun 16 12:01:11.277057 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-e0b5f408-5b38-4319-a068-b8c8284ef27e req-d18d4467-a8e7-43b5-9691-513bc415ae29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114156 Jun 16 12:01:11.277057 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 339/701] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:11.441500 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-208c9315-deb5-4d36-a878-aff13806a338 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:11.442665 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-208c9315-deb5-4d36-a878-aff13806a338 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:11.463298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-208c9315-deb5-4d36-a878-aff13806a338 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:11.464623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-208c9315-deb5-4d36-a878-aff13806a338 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:11.465429 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-208c9315-deb5-4d36-a878-aff13806a338 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:11.465970 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-208c9315-deb5-4d36-a878-aff13806a338 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:11.639725 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:11.640470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:11.642856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:11.648259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:11.648953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:11.649950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:11.650592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:11.716512 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:11.717188 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:11.717788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lazy-loading 'fault' on Instance uuid bd786b9e-48e7-4695-8549-aeabb6511e72 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:11.770114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:11.780351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-17c7b25f-854c-49aa-9b28-9748b55ee573 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 200 len: 1328 microversion: 2.1 time: 0.143399 Jun 16 12:01:11.781129 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 340/702] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:11 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 1328 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:11.822401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-208c9315-deb5-4d36-a878-aff13806a338 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:11.830751 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-208c9315-deb5-4d36-a878-aff13806a338 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.396549 Jun 16 12:01:11.831326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 363/703] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:11 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:12.119692 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f13da3e3-3032-4891-80e4-9d4366102d29 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:12.120728 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f13da3e3-3032-4891-80e4-9d4366102d29 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:12.128132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f13da3e3-3032-4891-80e4-9d4366102d29 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.133175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f13da3e3-3032-4891-80e4-9d4366102d29 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.133175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f13da3e3-3032-4891-80e4-9d4366102d29 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.133175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f13da3e3-3032-4891-80e4-9d4366102d29 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.189982 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b585d3be-0bb6-442e-a6d8-018f5ffda16d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:12.191953 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b585d3be-0bb6-442e-a6d8-018f5ffda16d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:12.204804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b585d3be-0bb6-442e-a6d8-018f5ffda16d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.206875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b585d3be-0bb6-442e-a6d8-018f5ffda16d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.207960 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b585d3be-0bb6-442e-a6d8-018f5ffda16d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.208657 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b585d3be-0bb6-442e-a6d8-018f5ffda16d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.258759 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b585d3be-0bb6-442e-a6d8-018f5ffda16d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075584 Jun 16 12:01:12.263511 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 364/704] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:01:12 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:12.265549 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-cc6fff6e-4112-4c25-a02e-e6a08ef2caa6 req-3e107b97-a9b9-426a-bd60-f3e0752f4dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b481fc54-9d0a-4ce3-a4f8-651a22d1d276", "tag": "7856f81f-be70-45db-80ed-79a45bca3b14"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:12.279369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-cc6fff6e-4112-4c25-a02e-e6a08ef2caa6 req-3e107b97-a9b9-426a-bd60-f3e0752f4dc1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.280217 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-cc6fff6e-4112-4c25-a02e-e6a08ef2caa6 req-3e107b97-a9b9-426a-bd60-f3e0752f4dc1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.294798 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-cc6fff6e-4112-4c25-a02e-e6a08ef2caa6 req-3e107b97-a9b9-426a-bd60-f3e0752f4dc1 service nova] Creating event network-changed:7856f81f-be70-45db-80ed-79a45bca3b14 for instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 on hv-cinder-84614 Jun 16 12:01:12.302816 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-cc6fff6e-4112-4c25-a02e-e6a08ef2caa6 req-3e107b97-a9b9-426a-bd60-f3e0752f4dc1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040695 Jun 16 12:01:12.303525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 365/705] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:12.475986 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f13da3e3-3032-4891-80e4-9d4366102d29 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:12.488497 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f13da3e3-3032-4891-80e4-9d4366102d29 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.373510 Jun 16 12:01:12.489091 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 341/706] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:12 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:12.799227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:12.799988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:12.808037 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.816328 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.817628 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.818242 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.853467 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-67befc3b-ae86-4d42-8a22-34ca65004499 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:12.855364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-67befc3b-ae86-4d42-8a22-34ca65004499 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:12.861290 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] HTTP exception thrown: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Request method failure captured: Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 HTTP/1.1 Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpc9C6OjINLkNYB-_C7T23VVwj_fAT660uiISCslXmp-_9qG3MlmzQNZ-0EXwXaDcVjLlpfTQdgw1VC5krSG8_qM_7OoSGADKwHjm9mzw4fvQfX3w4KXcy6Jup8k7OWfx-lkKTqEd_PkrRTFBI0-utcj1tKdobYkYEae3e-JZtk1Qc Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:01:12.864901 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 13d8c04611e24dffad16f8bb97e111f2 Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:01:12.866673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'bd786b9e-48e7-4695-8549-aeabb6511e72'} Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:12.867607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:01:12.869153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:12.873870 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Returning 404 to user: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:12.876359 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-67befc3b-ae86-4d42-8a22-34ca65004499 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.877333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5bac9805-7bf2-447e-95f6-55a67b6d976a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 404 len: 111 microversion: 2.1 time: 0.080778 Jun 16 12:01:12.879064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 366/707] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:12 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:01:12.880594 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-67befc3b-ae86-4d42-8a22-34ca65004499 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.883038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-67befc3b-ae86-4d42-8a22-34ca65004499 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:12.885141 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-67befc3b-ae86-4d42-8a22-34ca65004499 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:12.892690 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-5f4e474c-45ee-49f0-aef2-044f6195d516 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '.version_select at 0x7f4334189b80>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:12.986345 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-5f4e474c-45ee-49f0-aef2-044f6195d516 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101293772" status: 202 len: 0 microversion: 2.1 time: 0.102078 Jun 16 12:01:12.987172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 367/708] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 12:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101293772 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:01:13.203165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-67befc3b-ae86-4d42-8a22-34ca65004499 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:13.212184 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:13.214598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-67befc3b-ae86-4d42-8a22-34ca65004499 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.364778 Jun 16 12:01:13.215252 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 342/709] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:12 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:13.236591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=8 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:13.271495 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-66942478-857d-4a0e-ad36-1f3c643427dc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:13.275560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-66942478-857d-4a0e-ad36-1f3c643427dc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:13.289198 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-66942478-857d-4a0e-ad36-1f3c643427dc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:13.289647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-66942478-857d-4a0e-ad36-1f3c643427dc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:13.290627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-66942478-857d-4a0e-ad36-1f3c643427dc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:13.290867 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-66942478-857d-4a0e-ad36-1f3c643427dc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:13.304369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c8bd5edc-8c7f-4506-89ef-0db650b1e032 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Action: 'create', calling method: .version_select at 0x7f4334184790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1690805727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvaj11vyV/P10s//lS8ZvGDWsMeuJDBe+JSLwQoUvXVqR18TjSurTtRMVVxBGGR2hKfcoaK8ji6ElOpO2um14VakkmfXduw5FNEmfA9/lGpC5E4ei0Q/7EfbuiyeKRvwA=="}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:13.340099 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-c8bd5edc-8c7f-4506-89ef-0db650b1e032 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Getting quotas for project 4be7fa7276cb42d3a8b6dd0dd12cd784. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:01:13.352182 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-c8bd5edc-8c7f-4506-89ef-0db650b1e032 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Getting quotas for user f6e726651e4c49b794f5c86e1fe51d9c and project 4be7fa7276cb42d3a8b6dd0dd12cd784. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:01:13.368792 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-66942478-857d-4a0e-ad36-1f3c643427dc tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102024 Jun 16 12:01:13.373473 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 343/710] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:01:13 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 12:01:13.460687 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2976415c-54aa-4d5c-856e-48b5914f811e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:13.461763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2976415c-54aa-4d5c-856e-48b5914f811e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:13.465069 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c8bd5edc-8c7f-4506-89ef-0db650b1e032 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.463778 Jun 16 12:01:13.465745 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 368/711] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 12:01:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:01:13.469691 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2976415c-54aa-4d5c-856e-48b5914f811e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:13.470629 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2976415c-54aa-4d5c-856e-48b5914f811e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:13.471981 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2976415c-54aa-4d5c-856e-48b5914f811e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:13.472663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2976415c-54aa-4d5c-856e-48b5914f811e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:13.506219 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3e2280b8-c73b-4a8b-ac2a-7aac6b30a40b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:13.506844 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3e2280b8-c73b-4a8b-ac2a-7aac6b30a40b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:13.517142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3e2280b8-c73b-4a8b-ac2a-7aac6b30a40b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:13.517930 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3e2280b8-c73b-4a8b-ac2a-7aac6b30a40b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:13.518976 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3e2280b8-c73b-4a8b-ac2a-7aac6b30a40b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:13.519676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3e2280b8-c73b-4a8b-ac2a-7aac6b30a40b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:13.527006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2976415c-54aa-4d5c-856e-48b5914f811e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Going to try to terminate instance {{(pid=125055) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:01:13.552153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:13.589928 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:13.852529 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2976415c-54aa-4d5c-856e-48b5914f811e tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 204 len: 0 microversion: 2.1 time: 0.395359 Jun 16 12:01:13.853954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 344/712] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:01:13 2022] DELETE /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 12:01:13.863332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3e2280b8-c73b-4a8b-ac2a-7aac6b30a40b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:13.865402 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ddf6c073-7661-45dc-bfdc-0d9693ca7a38 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:13.866987 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ddf6c073-7661-45dc-bfdc-0d9693ca7a38 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:13.871392 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3e2280b8-c73b-4a8b-ac2a-7aac6b30a40b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.370112 Jun 16 12:01:13.871988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 369/713] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:13 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:13.878394 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ddf6c073-7661-45dc-bfdc-0d9693ca7a38 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:13.879166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ddf6c073-7661-45dc-bfdc-0d9693ca7a38 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:13.881560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ddf6c073-7661-45dc-bfdc-0d9693ca7a38 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:13.882864 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ddf6c073-7661-45dc-bfdc-0d9693ca7a38 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:14.235557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-12e7a107-b97a-4a36-b10b-1087fcb0ec16 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:14.237085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-12e7a107-b97a-4a36-b10b-1087fcb0ec16 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:14.245721 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-12e7a107-b97a-4a36-b10b-1087fcb0ec16 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:14.248890 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-12e7a107-b97a-4a36-b10b-1087fcb0ec16 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:14.249994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-12e7a107-b97a-4a36-b10b-1087fcb0ec16 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:14.250627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-12e7a107-b97a-4a36-b10b-1087fcb0ec16 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:14.394223 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ddf6c073-7661-45dc-bfdc-0d9693ca7a38 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:14.407894 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ddf6c073-7661-45dc-bfdc-0d9693ca7a38 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1689 microversion: 2.1 time: 0.548666 Jun 16 12:01:14.409082 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 345/714] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:13 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1689 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:14.418755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-12e7a107-b97a-4a36-b10b-1087fcb0ec16 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:14.421604 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-25e7420a-c3b2-44fa-96ea-cf0a0d828fbc req-eb258725-84d5-45e8-a0f4-c9d3335ff002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92dcff2-3f99-42cc-ba24-52bc94d88986", "tag": "7a3bc920-a057-45f1-b3ee-bc1f2c74986b"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:14.430021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-12e7a107-b97a-4a36-b10b-1087fcb0ec16 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.202214 Jun 16 12:01:14.431062 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 370/715] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:14 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:14.431725 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-25e7420a-c3b2-44fa-96ea-cf0a0d828fbc req-eb258725-84d5-45e8-a0f4-c9d3335ff002 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:14.432858 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-25e7420a-c3b2-44fa-96ea-cf0a0d828fbc req-eb258725-84d5-45e8-a0f4-c9d3335ff002 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:14.447391 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-25e7420a-c3b2-44fa-96ea-cf0a0d828fbc req-eb258725-84d5-45e8-a0f4-c9d3335ff002 service nova] Creating event network-changed:7a3bc920-a057-45f1-b3ee-bc1f2c74986b for instance f92dcff2-3f99-42cc-ba24-52bc94d88986 on hv-cinder-84614 Jun 16 12:01:14.453072 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-25e7420a-c3b2-44fa-96ea-cf0a0d828fbc req-eb258725-84d5-45e8-a0f4-c9d3335ff002 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042253 Jun 16 12:01:14.453738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 346/716] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:14.888338 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-766effef-05b3-49aa-8e94-7ddd6b492c21 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:14.889675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-766effef-05b3-49aa-8e94-7ddd6b492c21 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:14.896765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-766effef-05b3-49aa-8e94-7ddd6b492c21 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:14.905056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-766effef-05b3-49aa-8e94-7ddd6b492c21 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:14.905056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-766effef-05b3-49aa-8e94-7ddd6b492c21 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:14.905056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-766effef-05b3-49aa-8e94-7ddd6b492c21 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:15.068222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=10 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:15.074003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a9da05d6-4279-4d28-bc1e-322b26d33d1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'create', calling method: .version_select at 0x7f43345f03a0>, body: {"keypair": {"name": "tempest-keypair-1305258255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6ZQtq8QH+E1iEx8x/JuHYClLsJ5f1g6sqh4Jz1qtYDIkGwJzMybi9YFxq2qXvvUXI/ojxyyb9Pk7ZrlyMPXsvH+YgzE9coewbAWhMr8H7mzenENNULtf/OpoecErjNqw=="}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:15.090550 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-a9da05d6-4279-4d28-bc1e-322b26d33d1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Getting quotas for project 918001434f5c4d76a3ab9c46616eec67. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:01:15.094864 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-a9da05d6-4279-4d28-bc1e-322b26d33d1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Getting quotas for user 13d8c04611e24dffad16f8bb97e111f2 and project 918001434f5c4d76a3ab9c46616eec67. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:01:15.109087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-766effef-05b3-49aa-8e94-7ddd6b492c21 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:15.117358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-766effef-05b3-49aa-8e94-7ddd6b492c21 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.233160 Jun 16 12:01:15.118027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 371/717] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:14 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:15.190919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a9da05d6-4279-4d28-bc1e-322b26d33d1a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124885 Jun 16 12:01:15.191524 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 347/718] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 12:01:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:01:15.426360 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a097b81b-ab62-4e3b-a060-89afd58c2022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:15.427908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a097b81b-ab62-4e3b-a060-89afd58c2022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:15.435766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a097b81b-ab62-4e3b-a060-89afd58c2022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:15.436620 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a097b81b-ab62-4e3b-a060-89afd58c2022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:15.437665 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a097b81b-ab62-4e3b-a060-89afd58c2022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:15.438100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a097b81b-ab62-4e3b-a060-89afd58c2022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:15.450775 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d00cf94b-9c2e-4a8e-a05a-80bd7f2e407e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:15.457200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d00cf94b-9c2e-4a8e-a05a-80bd7f2e407e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:15.460281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d00cf94b-9c2e-4a8e-a05a-80bd7f2e407e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:15.460732 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d00cf94b-9c2e-4a8e-a05a-80bd7f2e407e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:15.461549 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d00cf94b-9c2e-4a8e-a05a-80bd7f2e407e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:15.462188 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d00cf94b-9c2e-4a8e-a05a-80bd7f2e407e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:15.617491 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a097b81b-ab62-4e3b-a060-89afd58c2022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:15.625569 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a097b81b-ab62-4e3b-a060-89afd58c2022 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1689 microversion: 2.1 time: 0.203618 Jun 16 12:01:15.626138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 372/719] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:15 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:15.654735 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d00cf94b-9c2e-4a8e-a05a-80bd7f2e407e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:15.662869 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d00cf94b-9c2e-4a8e-a05a-80bd7f2e407e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.217445 Jun 16 12:01:15.663438 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 348/720] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:15 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:16.134380 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-94bbed25-542f-4fae-8764-fdac79579c1c tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:16.134979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-94bbed25-542f-4fae-8764-fdac79579c1c tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:16.142160 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-94bbed25-542f-4fae-8764-fdac79579c1c tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:16.142601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-94bbed25-542f-4fae-8764-fdac79579c1c tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:16.143474 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-94bbed25-542f-4fae-8764-fdac79579c1c tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:16.143945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-94bbed25-542f-4fae-8764-fdac79579c1c tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:16.281689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-1f901257-8a29-48cb-b705-a11c47a51ad4 req-4ff8ebdf-9dbb-4ffb-ab17-4b886bd51824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd54546-c04b-4baa-be84-8b3db4c724fc", "name": "network-vif-plugged", "status": "completed", "tag": "bb4fb330-aa18-4a4a-8209-5d2e1df86614"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:16.291096 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-1f901257-8a29-48cb-b705-a11c47a51ad4 req-4ff8ebdf-9dbb-4ffb-ab17-4b886bd51824 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:16.297794 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-1f901257-8a29-48cb-b705-a11c47a51ad4 req-4ff8ebdf-9dbb-4ffb-ab17-4b886bd51824 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:16.302806 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-1f901257-8a29-48cb-b705-a11c47a51ad4 req-4ff8ebdf-9dbb-4ffb-ab17-4b886bd51824 service nova] Creating event network-vif-plugged:bb4fb330-aa18-4a4a-8209-5d2e1df86614 for instance 0fd54546-c04b-4baa-be84-8b3db4c724fc on hv-cinder-84614 Jun 16 12:01:16.308425 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-1f901257-8a29-48cb-b705-a11c47a51ad4 req-4ff8ebdf-9dbb-4ffb-ab17-4b886bd51824 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Jun 16 12:01:16.309183 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 349/721] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:16.324884 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-94bbed25-542f-4fae-8764-fdac79579c1c tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:16.329566 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-94bbed25-542f-4fae-8764-fdac79579c1c tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.198961 Jun 16 12:01:16.330209 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 373/722] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:16 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:16.642330 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ce50a7fc-acbd-4699-9beb-7cf943ba9696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:16.643042 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ce50a7fc-acbd-4699-9beb-7cf943ba9696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:16.649831 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ce50a7fc-acbd-4699-9beb-7cf943ba9696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:16.650402 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ce50a7fc-acbd-4699-9beb-7cf943ba9696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:16.651492 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ce50a7fc-acbd-4699-9beb-7cf943ba9696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:16.652411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ce50a7fc-acbd-4699-9beb-7cf943ba9696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:16.685372 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-85bfdb74-f7b3-4e44-bdb8-753180d9aae2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:16.690664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-85bfdb74-f7b3-4e44-bdb8-753180d9aae2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:16.707242 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85bfdb74-f7b3-4e44-bdb8-753180d9aae2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:16.707704 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85bfdb74-f7b3-4e44-bdb8-753180d9aae2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:16.708647 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85bfdb74-f7b3-4e44-bdb8-753180d9aae2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:16.709085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85bfdb74-f7b3-4e44-bdb8-753180d9aae2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:16.997296 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ce50a7fc-acbd-4699-9beb-7cf943ba9696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:17.008597 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ce50a7fc-acbd-4699-9beb-7cf943ba9696 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1689 microversion: 2.1 time: 0.367435 Jun 16 12:01:17.009534 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 350/723] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:16 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1689 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:17.022710 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-85bfdb74-f7b3-4e44-bdb8-753180d9aae2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:17.031436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-85bfdb74-f7b3-4e44-bdb8-753180d9aae2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.350304 Jun 16 12:01:17.032274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 374/724] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:16 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:17.346248 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2c91d25e-35be-47ae-947d-fff4b50d3729 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:17.347492 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2c91d25e-35be-47ae-947d-fff4b50d3729 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:17.356883 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2c91d25e-35be-47ae-947d-fff4b50d3729 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:17.358513 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2c91d25e-35be-47ae-947d-fff4b50d3729 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:17.359287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2c91d25e-35be-47ae-947d-fff4b50d3729 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:17.359711 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2c91d25e-35be-47ae-947d-fff4b50d3729 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:17.605076 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2c91d25e-35be-47ae-947d-fff4b50d3729 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:17.615970 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2c91d25e-35be-47ae-947d-fff4b50d3729 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.273554 Jun 16 12:01:17.617057 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 351/725] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:17 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:18.026111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d6c70e6d-60e2-412a-8bd4-37236bc9abdd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:18.026819 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d6c70e6d-60e2-412a-8bd4-37236bc9abdd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:18.033773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6c70e6d-60e2-412a-8bd4-37236bc9abdd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:18.035924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6c70e6d-60e2-412a-8bd4-37236bc9abdd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:18.035924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6c70e6d-60e2-412a-8bd4-37236bc9abdd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:18.035924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6c70e6d-60e2-412a-8bd4-37236bc9abdd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:18.048558 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4d01a31e-5a89-4cba-877e-2efa2b92469f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:18.049165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4d01a31e-5a89-4cba-877e-2efa2b92469f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:18.055189 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4d01a31e-5a89-4cba-877e-2efa2b92469f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:18.055624 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4d01a31e-5a89-4cba-877e-2efa2b92469f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:18.056608 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4d01a31e-5a89-4cba-877e-2efa2b92469f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:18.057619 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4d01a31e-5a89-4cba-877e-2efa2b92469f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:18.192953 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d6c70e6d-60e2-412a-8bd4-37236bc9abdd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:18.205475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d6c70e6d-60e2-412a-8bd4-37236bc9abdd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1689 microversion: 2.1 time: 0.182993 Jun 16 12:01:18.218159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 375/726] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:18 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:18.218159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1405170186", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28a421b2-7f17-4f12-b999-37b4d5461541"}], "security_groups": [{"name": "tempest-securitygroup--362997922"}], "key_name": "tempest-keypair-1305258255", "user_data": "}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:18.220179 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:18.445580 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4d01a31e-5a89-4cba-877e-2efa2b92469f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:18.456206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4d01a31e-5a89-4cba-877e-2efa2b92469f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.409577 Jun 16 12:01:18.456206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 352/727] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:18 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:18.490888 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] validate_networks() for [('28a421b2-7f17-4f12-b999-37b4d5461541', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:01:18.634868 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e5bd6f2a-a246-4410-b5e3-2322ef66db25 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:18.636533 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e5bd6f2a-a246-4410-b5e3-2322ef66db25 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:18.649197 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e5bd6f2a-a246-4410-b5e3-2322ef66db25 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:18.651190 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e5bd6f2a-a246-4410-b5e3-2322ef66db25 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:18.652370 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e5bd6f2a-a246-4410-b5e3-2322ef66db25 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:18.653111 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e5bd6f2a-a246-4410-b5e3-2322ef66db25 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:18.949740 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e5bd6f2a-a246-4410-b5e3-2322ef66db25 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:18.965597 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e5bd6f2a-a246-4410-b5e3-2322ef66db25 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1319 microversion: 2.1 time: 0.327279 Jun 16 12:01:18.966501 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 353/728] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:18 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:19.025666 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-6ae76ff6-0da7-4b76-a329-253508371c12 req-3e0a7fda-4317-4203-9739-148024fe23c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c202b5a-d86c-445a-9119-9b0893b15c1f", "name": "network-vif-deleted", "tag": "f40c01cc-1a91-4c00-ac75-2e413104f6db"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:19.037613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-6ae76ff6-0da7-4b76-a329-253508371c12 req-3e0a7fda-4317-4203-9739-148024fe23c1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.038792 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-6ae76ff6-0da7-4b76-a329-253508371c12 req-3e0a7fda-4317-4203-9739-148024fe23c1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:19.052466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-6ae76ff6-0da7-4b76-a329-253508371c12 req-3e0a7fda-4317-4203-9739-148024fe23c1 service nova] Creating event network-vif-deleted:f40c01cc-1a91-4c00-ac75-2e413104f6db for instance 5c202b5a-d86c-445a-9119-9b0893b15c1f on hv-cinder-84614 Jun 16 12:01:19.057618 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:01:19.058169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:01:19.059008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:01:19.059584 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:01:19.060203 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:01:19.060644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-6ae76ff6-0da7-4b76-a329-253508371c12 req-3e0a7fda-4317-4203-9739-148024fe23c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036072 Jun 16 12:01:19.062525 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 354/729] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:01:19.074526 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.075208 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:19.076277 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.076720 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:19.103842 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Getting quotas for project 918001434f5c4d76a3ab9c46616eec67. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:01:19.108603 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Getting quotas for user 13d8c04611e24dffad16f8bb97e111f2 and project 918001434f5c4d76a3ab9c46616eec67. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:01:19.122140 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:01:19.126899 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:01:19.227361 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-80336ada-781e-44a6-bd25-f9f594c93b02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:19.228377 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-80336ada-781e-44a6-bd25-f9f594c93b02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:19.235561 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-80336ada-781e-44a6-bd25-f9f594c93b02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.236117 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-80336ada-781e-44a6-bd25-f9f594c93b02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:19.237037 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-80336ada-781e-44a6-bd25-f9f594c93b02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.237530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-80336ada-781e-44a6-bd25-f9f594c93b02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:19.294436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-235278c9-01e2-4e15-a1aa-e92e6225d0c8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.087487 Jun 16 12:01:19.300568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 376/730] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:01:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:01:19.305025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e25aa102-3da7-448e-8544-354a8381c3e2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:19.305638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e25aa102-3da7-448e-8544-354a8381c3e2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:19.312755 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-80336ada-781e-44a6-bd25-f9f594c93b02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:19.325975 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-80336ada-781e-44a6-bd25-f9f594c93b02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 200 len: 1330 microversion: 2.1 time: 0.102607 Jun 16 12:01:19.327784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 355/731] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:19 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:19.407047 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e25aa102-3da7-448e-8544-354a8381c3e2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:19.414323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e25aa102-3da7-448e-8544-354a8381c3e2 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1238 microversion: 2.1 time: 0.113033 Jun 16 12:01:19.416086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 377/732] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:19 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1238 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:19.474378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-42e285de-fde6-43a8-9439-75cbd8d0c6b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:19.475541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-42e285de-fde6-43a8-9439-75cbd8d0c6b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:19.482523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-42e285de-fde6-43a8-9439-75cbd8d0c6b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.483171 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-42e285de-fde6-43a8-9439-75cbd8d0c6b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:19.484157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-42e285de-fde6-43a8-9439-75cbd8d0c6b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.484751 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-42e285de-fde6-43a8-9439-75cbd8d0c6b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:19.647092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-42e285de-fde6-43a8-9439-75cbd8d0c6b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:19.655448 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-42e285de-fde6-43a8-9439-75cbd8d0c6b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.187902 Jun 16 12:01:19.663895 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 356/733] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:19 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:19.982515 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-38915490-3a3e-44ec-a0f8-c1774f3dbda4 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:19.983384 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-38915490-3a3e-44ec-a0f8-c1774f3dbda4 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:19.990680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-38915490-3a3e-44ec-a0f8-c1774f3dbda4 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.990680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-38915490-3a3e-44ec-a0f8-c1774f3dbda4 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:19.991476 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-38915490-3a3e-44ec-a0f8-c1774f3dbda4 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:19.991925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-38915490-3a3e-44ec-a0f8-c1774f3dbda4 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.130425 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-38915490-3a3e-44ec-a0f8-c1774f3dbda4 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:20.140532 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-38915490-3a3e-44ec-a0f8-c1774f3dbda4 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1508 microversion: 2.1 time: 0.161671 Jun 16 12:01:20.141611 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 378/734] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:19 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:20.157197 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-13f16835-a6df-45f7-9239-ceb6f9201e85 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4f5d642-267c-4943-85e2-401cf7462cce", "device": "/dev/sdb"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:20.164256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-13f16835-a6df-45f7-9239-ceb6f9201e85 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:20.164789 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13f16835-a6df-45f7-9239-ceb6f9201e85 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:20.165229 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13f16835-a6df-45f7-9239-ceb6f9201e85 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.166014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13f16835-a6df-45f7-9239-ceb6f9201e85 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:20.166467 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13f16835-a6df-45f7-9239-ceb6f9201e85 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.343393 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:20.344045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 5c202b5a-d86c-445a-9119-9b0893b15c1f] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:20.350487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:20.355256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.355256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:20.355256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.366371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] HTTP exception thrown: Instance 5c202b5a-d86c-445a-9119-9b0893b15c1f could not be found. Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Request method failure captured: Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f HTTP/1.1 Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpc5yamDpiSB8f7OnESQ50cHNirlCnyBfPHjqjB2vSHropmWxfJeAbxensZSeje0UBxZtS1HNRcfksjlI8EJUoG4R3_riom8WCNK9__EeEp9jMVJvO38Uq6nurzXiWCO-8HNMoTEdxp17CohHT0K0EyN4HbiE1r6_iJ8WtFdSM9gGI Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:01:20.367988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 6cdd0a7f3f12414ea85ebffc9d531773 Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 5c202b5a-d86c-445a-9119-9b0893b15c1f could not be found. Jun 16 12:01:20.369510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '5c202b5a-d86c-445a-9119-9b0893b15c1f'} Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c202b5a-d86c-445a-9119-9b0893b15c1f could not be found. Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:20.370892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c202b5a-d86c-445a-9119-9b0893b15c1f could not be found. Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c202b5a-d86c-445a-9119-9b0893b15c1f could not be found. Jun 16 12:01:20.377161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:20.378527 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Returning 404 to user: Instance 5c202b5a-d86c-445a-9119-9b0893b15c1f could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:20.378527 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6357c4d8-8536-4d60-a610-79aba14788dd tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f" status: 404 len: 111 microversion: 2.1 time: 0.030053 Jun 16 12:01:20.378527 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 379/735] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:20 2022] GET /compute/v2.1/servers/5c202b5a-d86c-445a-9119-9b0893b15c1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:01:20.378527 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-57757d3d-aadb-41a0-b475-38546f581c63 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '.version_select at 0x7f433426aee0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:20.475201 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-57757d3d-aadb-41a0-b475-38546f581c63 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428049835" status: 202 len: 0 microversion: 2.1 time: 0.100379 Jun 16 12:01:20.475767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 380/736] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 12:01:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428049835 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 12:01:20.480992 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-587a9d49-c40e-4d67-9415-31e43a64a302 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:20.482045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-587a9d49-c40e-4d67-9415-31e43a64a302 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:20.488897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-587a9d49-c40e-4d67-9415-31e43a64a302 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:20.489340 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-587a9d49-c40e-4d67-9415-31e43a64a302 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.490098 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-587a9d49-c40e-4d67-9415-31e43a64a302 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:20.490529 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-587a9d49-c40e-4d67-9415-31e43a64a302 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.568147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-587a9d49-c40e-4d67-9415-31e43a64a302 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:20.575632 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-587a9d49-c40e-4d67-9415-31e43a64a302 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1242 microversion: 2.1 time: 0.098859 Jun 16 12:01:20.579474 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 381/737] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:20 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:20.680930 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-641c1274-8d9c-474c-94ec-27012ccc6f61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:20.681561 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-641c1274-8d9c-474c-94ec-27012ccc6f61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:20.687839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-641c1274-8d9c-474c-94ec-27012ccc6f61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:20.688819 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-641c1274-8d9c-474c-94ec-27012ccc6f61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.689080 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-641c1274-8d9c-474c-94ec-27012ccc6f61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:20.689516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-641c1274-8d9c-474c-94ec-27012ccc6f61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:20.848286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-641c1274-8d9c-474c-94ec-27012ccc6f61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:20.856608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-641c1274-8d9c-474c-94ec-27012ccc6f61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.179610 Jun 16 12:01:20.857160 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 382/738] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:20 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:20.904910 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-13f16835-a6df-45f7-9239-ceb6f9201e85 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "POST /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750598 Jun 16 12:01:20.905752 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 357/739] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:01:20 2022] POST /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:21.593167 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2450f6b3-b616-493b-991b-89e831bfcd09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:21.593925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2450f6b3-b616-493b-991b-89e831bfcd09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:21.600865 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2450f6b3-b616-493b-991b-89e831bfcd09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:21.601327 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2450f6b3-b616-493b-991b-89e831bfcd09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:21.602101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2450f6b3-b616-493b-991b-89e831bfcd09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:21.602524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2450f6b3-b616-493b-991b-89e831bfcd09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:21.670727 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2450f6b3-b616-493b-991b-89e831bfcd09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:21.682339 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2450f6b3-b616-493b-991b-89e831bfcd09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1298 microversion: 2.1 time: 0.092607 Jun 16 12:01:21.682944 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 383/740] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:21 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:21.875394 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e8033353-e700-4b27-bdf0-915abfa07063 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:21.876344 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e8033353-e700-4b27-bdf0-915abfa07063 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:21.883955 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8033353-e700-4b27-bdf0-915abfa07063 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:21.884392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8033353-e700-4b27-bdf0-915abfa07063 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:21.885152 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8033353-e700-4b27-bdf0-915abfa07063 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:21.885577 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8033353-e700-4b27-bdf0-915abfa07063 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:22.120902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e8033353-e700-4b27-bdf0-915abfa07063 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:22.131098 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e8033353-e700-4b27-bdf0-915abfa07063 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.261286 Jun 16 12:01:22.135577 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 358/741] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:21 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:22.700699 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-67027be3-75f8-4a32-bdb9-8c1f367cac51 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:22.701415 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-67027be3-75f8-4a32-bdb9-8c1f367cac51 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:22.707552 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-67027be3-75f8-4a32-bdb9-8c1f367cac51 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:22.709708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-67027be3-75f8-4a32-bdb9-8c1f367cac51 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:22.709708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-67027be3-75f8-4a32-bdb9-8c1f367cac51 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:22.709708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-67027be3-75f8-4a32-bdb9-8c1f367cac51 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:22.859825 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-67027be3-75f8-4a32-bdb9-8c1f367cac51 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:22.867588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-67027be3-75f8-4a32-bdb9-8c1f367cac51 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.172550 Jun 16 12:01:22.877449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 384/742] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:22 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:23.150407 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-70d333bf-af54-4a01-be50-0457c2adc9c8 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:23.152536 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-70d333bf-af54-4a01-be50-0457c2adc9c8 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:23.161446 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-70d333bf-af54-4a01-be50-0457c2adc9c8 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:23.163038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-70d333bf-af54-4a01-be50-0457c2adc9c8 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:23.168680 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-70d333bf-af54-4a01-be50-0457c2adc9c8 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:23.168680 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-70d333bf-af54-4a01-be50-0457c2adc9c8 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:23.365568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-70d333bf-af54-4a01-be50-0457c2adc9c8 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:23.374685 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-70d333bf-af54-4a01-be50-0457c2adc9c8 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.229366 Jun 16 12:01:23.377463 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 359/743] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:23 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:23.469671 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-3068ed7a-57d4-4449-8d62-6ef1c7d10084 req-b4ee52e7-7d8d-4b8c-bca6-4048cc41bb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d2914d-7d2a-4623-b9c1-3b0752478f96", "tag": "0a6d60f9-c7ff-43a6-8e1e-5247b2c29563"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:23.483904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-3068ed7a-57d4-4449-8d62-6ef1c7d10084 req-b4ee52e7-7d8d-4b8c-bca6-4048cc41bb99 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:23.485591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-3068ed7a-57d4-4449-8d62-6ef1c7d10084 req-b4ee52e7-7d8d-4b8c-bca6-4048cc41bb99 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:23.503928 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-3068ed7a-57d4-4449-8d62-6ef1c7d10084 req-b4ee52e7-7d8d-4b8c-bca6-4048cc41bb99 service nova] Creating event network-changed:0a6d60f9-c7ff-43a6-8e1e-5247b2c29563 for instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 on hv-cinder-84614 Jun 16 12:01:23.514119 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-3068ed7a-57d4-4449-8d62-6ef1c7d10084 req-b4ee52e7-7d8d-4b8c-bca6-4048cc41bb99 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047874 Jun 16 12:01:23.516107 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 385/744] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:23.866025 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d797092a-4eea-43da-b7a9-0862646ce276 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:23.866523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d797092a-4eea-43da-b7a9-0862646ce276 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:23.873100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d797092a-4eea-43da-b7a9-0862646ce276 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:23.873546 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d797092a-4eea-43da-b7a9-0862646ce276 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:23.874318 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d797092a-4eea-43da-b7a9-0862646ce276 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:23.874754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d797092a-4eea-43da-b7a9-0862646ce276 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:23.884579 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4f0930cc-4a5f-4bfb-90c8-ab7a5aa5c354 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:23.885289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4f0930cc-4a5f-4bfb-90c8-ab7a5aa5c354 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:23.891808 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4f0930cc-4a5f-4bfb-90c8-ab7a5aa5c354 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:23.892275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4f0930cc-4a5f-4bfb-90c8-ab7a5aa5c354 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:23.893040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4f0930cc-4a5f-4bfb-90c8-ab7a5aa5c354 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:23.893469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4f0930cc-4a5f-4bfb-90c8-ab7a5aa5c354 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:23.901074 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d797092a-4eea-43da-b7a9-0862646ce276 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Going to try to terminate instance {{(pid=125055) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:01:24.035903 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4f0930cc-4a5f-4bfb-90c8-ab7a5aa5c354 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:24.043899 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4f0930cc-4a5f-4bfb-90c8-ab7a5aa5c354 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.163319 Jun 16 12:01:24.045244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:24.053327 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 386/745] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:23 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:24.263933 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d797092a-4eea-43da-b7a9-0862646ce276 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 204 len: 0 microversion: 2.1 time: 0.401287 Jun 16 12:01:24.264596 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 360/746] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:01:23 2022] DELETE /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:01:24.272525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3f284c50-a27c-47b4-80f4-ddc74e3663f9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:24.273172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3f284c50-a27c-47b4-80f4-ddc74e3663f9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:24.279814 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3f284c50-a27c-47b4-80f4-ddc74e3663f9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:24.280289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3f284c50-a27c-47b4-80f4-ddc74e3663f9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:24.281194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3f284c50-a27c-47b4-80f4-ddc74e3663f9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:24.281627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3f284c50-a27c-47b4-80f4-ddc74e3663f9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:24.391839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0526641d-6c4f-478a-baeb-e85539ec04df tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:24.393097 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0526641d-6c4f-478a-baeb-e85539ec04df tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:24.399511 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0526641d-6c4f-478a-baeb-e85539ec04df tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:24.400226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0526641d-6c4f-478a-baeb-e85539ec04df tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:24.401636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0526641d-6c4f-478a-baeb-e85539ec04df tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:24.402072 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0526641d-6c4f-478a-baeb-e85539ec04df tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:24.419067 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3f284c50-a27c-47b4-80f4-ddc74e3663f9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:24.426430 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3f284c50-a27c-47b4-80f4-ddc74e3663f9 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1508 microversion: 2.1 time: 0.157696 Jun 16 12:01:24.426986 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 387/747] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:24 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:24.545584 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0526641d-6c4f-478a-baeb-e85539ec04df tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:24.553103 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0526641d-6c4f-478a-baeb-e85539ec04df tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.165597 Jun 16 12:01:24.553663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 361/748] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:24 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:25.061700 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-15a13424-e404-4f3b-803c-7610ff69eac7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:25.062303 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-15a13424-e404-4f3b-803c-7610ff69eac7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:25.069918 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a13424-e404-4f3b-803c-7610ff69eac7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:25.070358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a13424-e404-4f3b-803c-7610ff69eac7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:25.071128 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a13424-e404-4f3b-803c-7610ff69eac7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:25.071602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a13424-e404-4f3b-803c-7610ff69eac7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:25.203525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-15a13424-e404-4f3b-803c-7610ff69eac7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:25.211177 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-15a13424-e404-4f3b-803c-7610ff69eac7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.154346 Jun 16 12:01:25.211733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 388/749] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:25 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:25.443859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-eb7a2dfc-9bfc-4369-a62e-81af2d932e04 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:25.444560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-eb7a2dfc-9bfc-4369-a62e-81af2d932e04 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:25.451164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eb7a2dfc-9bfc-4369-a62e-81af2d932e04 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:25.451606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eb7a2dfc-9bfc-4369-a62e-81af2d932e04 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:25.452404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eb7a2dfc-9bfc-4369-a62e-81af2d932e04 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:25.452837 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eb7a2dfc-9bfc-4369-a62e-81af2d932e04 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:25.570872 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1cdbee54-2d7a-4d99-84c6-93647f27ab61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:25.571470 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-1cdbee54-2d7a-4d99-84c6-93647f27ab61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:25.581336 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1cdbee54-2d7a-4d99-84c6-93647f27ab61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:25.581765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1cdbee54-2d7a-4d99-84c6-93647f27ab61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:25.582544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1cdbee54-2d7a-4d99-84c6-93647f27ab61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:25.582972 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1cdbee54-2d7a-4d99-84c6-93647f27ab61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:25.584037 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-eb7a2dfc-9bfc-4369-a62e-81af2d932e04 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:25.592423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-eb7a2dfc-9bfc-4369-a62e-81af2d932e04 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1508 microversion: 2.1 time: 0.152454 Jun 16 12:01:25.592993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 362/750] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:25 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:25.723019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1cdbee54-2d7a-4d99-84c6-93647f27ab61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:25.723606 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:25.727923 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1cdbee54-2d7a-4d99-84c6-93647f27ab61 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.161185 Jun 16 12:01:25.728542 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 389/751] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:25 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:26.229253 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7f41cf08-054d-46be-a50d-f19d9306798a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:26.230386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7f41cf08-054d-46be-a50d-f19d9306798a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:26.236964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7f41cf08-054d-46be-a50d-f19d9306798a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:26.237409 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7f41cf08-054d-46be-a50d-f19d9306798a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:26.238222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7f41cf08-054d-46be-a50d-f19d9306798a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:26.238643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7f41cf08-054d-46be-a50d-f19d9306798a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:26.290227 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=4 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:26.312287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-907b9364-62b9-4a70-a434-87ba41c79ed4 req-042413cc-e31f-41cc-b7f3-e18cd46c9faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b481fc54-9d0a-4ce3-a4f8-651a22d1d276", "name": "network-vif-plugged", "status": "completed", "tag": "7856f81f-be70-45db-80ed-79a45bca3b14"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:26.324358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-907b9364-62b9-4a70-a434-87ba41c79ed4 req-042413cc-e31f-41cc-b7f3-e18cd46c9faf service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:26.324358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-907b9364-62b9-4a70-a434-87ba41c79ed4 req-042413cc-e31f-41cc-b7f3-e18cd46c9faf service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:26.335737 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-907b9364-62b9-4a70-a434-87ba41c79ed4 req-042413cc-e31f-41cc-b7f3-e18cd46c9faf service nova] Creating event network-vif-plugged:7856f81f-be70-45db-80ed-79a45bca3b14 for instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 on hv-cinder-84614 Jun 16 12:01:26.341289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-907b9364-62b9-4a70-a434-87ba41c79ed4 req-042413cc-e31f-41cc-b7f3-e18cd46c9faf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034004 Jun 16 12:01:26.342042 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 390/752] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:26.380417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7f41cf08-054d-46be-a50d-f19d9306798a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:26.390796 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7f41cf08-054d-46be-a50d-f19d9306798a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.165528 Jun 16 12:01:26.393814 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 363/753] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:26 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:26.610906 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-eaa269a3-38ba-4e0b-92c9-15b38dfa3f02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:26.611583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-eaa269a3-38ba-4e0b-92c9-15b38dfa3f02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:26.617837 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eaa269a3-38ba-4e0b-92c9-15b38dfa3f02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:26.618282 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eaa269a3-38ba-4e0b-92c9-15b38dfa3f02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:26.619047 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eaa269a3-38ba-4e0b-92c9-15b38dfa3f02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:26.619481 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eaa269a3-38ba-4e0b-92c9-15b38dfa3f02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:26.743709 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3728411d-775b-4678-907d-bb639616cc7c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:26.744337 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3728411d-775b-4678-907d-bb639616cc7c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:26.751370 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3728411d-775b-4678-907d-bb639616cc7c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:26.752185 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3728411d-775b-4678-907d-bb639616cc7c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:26.756752 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3728411d-775b-4678-907d-bb639616cc7c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:26.756752 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3728411d-775b-4678-907d-bb639616cc7c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:26.757064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-eaa269a3-38ba-4e0b-92c9-15b38dfa3f02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:26.764280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-eaa269a3-38ba-4e0b-92c9-15b38dfa3f02 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1508 microversion: 2.1 time: 0.157461 Jun 16 12:01:26.773798 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 391/754] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:26 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:26.950075 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3728411d-775b-4678-907d-bb639616cc7c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:26.961155 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3728411d-775b-4678-907d-bb639616cc7c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.221138 Jun 16 12:01:26.961745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 364/755] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:26 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:27.408145 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a847a655-c251-4ccb-86fa-3f90540c8b95 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:27.408743 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a847a655-c251-4ccb-86fa-3f90540c8b95 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:27.415547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a847a655-c251-4ccb-86fa-3f90540c8b95 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:27.416196 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a847a655-c251-4ccb-86fa-3f90540c8b95 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:27.417165 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a847a655-c251-4ccb-86fa-3f90540c8b95 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:27.417742 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a847a655-c251-4ccb-86fa-3f90540c8b95 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:27.554687 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a847a655-c251-4ccb-86fa-3f90540c8b95 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:27.562736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a847a655-c251-4ccb-86fa-3f90540c8b95 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.158499 Jun 16 12:01:27.563297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 392/756] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:27 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:27.715560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-924d8a19-4920-4316-a038-478f8c75986a req-ad0fa3e6-9e35-4243-b360-755993369c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cfe043-70c3-4137-b979-cfab2e3c1bab", "name": "network-vif-deleted", "tag": "d8badd83-339f-4e1b-8b96-c3f43fb0a109"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:27.724918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-924d8a19-4920-4316-a038-478f8c75986a req-ad0fa3e6-9e35-4243-b360-755993369c1d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:27.725346 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-924d8a19-4920-4316-a038-478f8c75986a req-ad0fa3e6-9e35-4243-b360-755993369c1d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:27.751072 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-924d8a19-4920-4316-a038-478f8c75986a req-ad0fa3e6-9e35-4243-b360-755993369c1d service nova] Creating event network-vif-deleted:d8badd83-339f-4e1b-8b96-c3f43fb0a109 for instance a0cfe043-70c3-4137-b979-cfab2e3c1bab on hv-cinder-84614 Jun 16 12:01:27.756746 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-924d8a19-4920-4316-a038-478f8c75986a req-ad0fa3e6-9e35-4243-b360-755993369c1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045176 Jun 16 12:01:27.757397 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 365/757] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:27.780784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c4e50544-2937-491d-bb68-dedf600ba2db tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:27.781394 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c4e50544-2937-491d-bb68-dedf600ba2db tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:27.787316 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4e50544-2937-491d-bb68-dedf600ba2db tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:27.787769 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4e50544-2937-491d-bb68-dedf600ba2db tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:27.788585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4e50544-2937-491d-bb68-dedf600ba2db tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:27.789203 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4e50544-2937-491d-bb68-dedf600ba2db tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:27.869176 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c4e50544-2937-491d-bb68-dedf600ba2db tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:27.877024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c4e50544-2937-491d-bb68-dedf600ba2db tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1466 microversion: 2.1 time: 0.100088 Jun 16 12:01:27.877597 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 393/758] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:27 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1466 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:27.979192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-27cd01fb-2aa9-43c5-b8cd-30105ef1369a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:27.979914 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-27cd01fb-2aa9-43c5-b8cd-30105ef1369a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:27.986147 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-27cd01fb-2aa9-43c5-b8cd-30105ef1369a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:27.986593 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-27cd01fb-2aa9-43c5-b8cd-30105ef1369a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:27.987347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-27cd01fb-2aa9-43c5-b8cd-30105ef1369a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:27.987777 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-27cd01fb-2aa9-43c5-b8cd-30105ef1369a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:28.133435 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-27cd01fb-2aa9-43c5-b8cd-30105ef1369a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:28.141789 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-27cd01fb-2aa9-43c5-b8cd-30105ef1369a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.166623 Jun 16 12:01:28.142689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 366/759] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:27 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:28.580036 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-76089324-460a-41e6-89de-f30a4d401fe9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:28.580587 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-76089324-460a-41e6-89de-f30a4d401fe9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:28.587012 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-76089324-460a-41e6-89de-f30a4d401fe9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:28.587647 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-76089324-460a-41e6-89de-f30a4d401fe9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:28.588447 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-76089324-460a-41e6-89de-f30a4d401fe9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:28.588883 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-76089324-460a-41e6-89de-f30a4d401fe9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:28.721764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-76089324-460a-41e6-89de-f30a4d401fe9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:28.729393 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-76089324-460a-41e6-89de-f30a4d401fe9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.153332 Jun 16 12:01:28.730470 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 394/760] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:28 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:28.894817 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:28.895667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:28.902741 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:28.903189 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:28.903967 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:28.904399 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:28.931643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:28.935177 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:28.935613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:28.936084 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'fault' on Instance uuid a0cfe043-70c3-4137-b979-cfab2e3c1bab {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:28.978691 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:28.986203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d38b0cf6-f62b-4072-a586-2a7903bf8881 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1312 microversion: 2.1 time: 0.095716 Jun 16 12:01:28.986827 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 367/761] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:28 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:29.158615 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cf0afc16-c44c-47ae-8bd4-52ce7278e064 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:29.159252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cf0afc16-c44c-47ae-8bd4-52ce7278e064 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:29.161266 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:29.166428 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf0afc16-c44c-47ae-8bd4-52ce7278e064 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:29.166919 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf0afc16-c44c-47ae-8bd4-52ce7278e064 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:29.168203 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf0afc16-c44c-47ae-8bd4-52ce7278e064 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:29.168804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf0afc16-c44c-47ae-8bd4-52ce7278e064 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:29.297856 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cf0afc16-c44c-47ae-8bd4-52ce7278e064 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:29.305407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cf0afc16-c44c-47ae-8bd4-52ce7278e064 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1259 microversion: 2.1 time: 0.150770 Jun 16 12:01:29.305977 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 395/762] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:29 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:29.746668 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f3b83310-7ed0-4ee4-99c2-39fdf2a7484f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:29.747272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f3b83310-7ed0-4ee4-99c2-39fdf2a7484f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:29.753832 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f3b83310-7ed0-4ee4-99c2-39fdf2a7484f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:29.754274 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f3b83310-7ed0-4ee4-99c2-39fdf2a7484f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:29.755031 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f3b83310-7ed0-4ee4-99c2-39fdf2a7484f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:29.755490 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f3b83310-7ed0-4ee4-99c2-39fdf2a7484f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:29.882266 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f3b83310-7ed0-4ee4-99c2-39fdf2a7484f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:29.889768 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f3b83310-7ed0-4ee4-99c2-39fdf2a7484f tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.147049 Jun 16 12:01:29.890350 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 368/763] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:29 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:30.002309 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:30.002918 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:30.004739 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=12 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:30.009998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.010443 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:30.011710 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.012176 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:30.042111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.042562 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:30.043000 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'fault' on Instance uuid a0cfe043-70c3-4137-b979-cfab2e3c1bab {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:30.085406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:30.093538 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1baee29e-561e-4d81-b5af-de9fb729dd0c tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 200 len: 1312 microversion: 2.1 time: 0.094904 Jun 16 12:01:30.094159 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 396/764] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:29 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:30.322447 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-461d405e-b79e-4e2a-920e-d540b5fe0344 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:30.323156 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-461d405e-b79e-4e2a-920e-d540b5fe0344 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:30.330573 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-461d405e-b79e-4e2a-920e-d540b5fe0344 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.331089 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-461d405e-b79e-4e2a-920e-d540b5fe0344 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:30.331960 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-461d405e-b79e-4e2a-920e-d540b5fe0344 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.332472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-461d405e-b79e-4e2a-920e-d540b5fe0344 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:30.475150 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-461d405e-b79e-4e2a-920e-d540b5fe0344 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:30.482970 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-461d405e-b79e-4e2a-920e-d540b5fe0344 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1443 microversion: 2.1 time: 0.164407 Jun 16 12:01:30.483556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 369/765] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:30 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:30.499727 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-70582421-b840-4445-bfa7-6b7370587841 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:30.500438 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-70582421-b840-4445-bfa7-6b7370587841 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:30.506424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70582421-b840-4445-bfa7-6b7370587841 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.506867 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70582421-b840-4445-bfa7-6b7370587841 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:30.507629 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70582421-b840-4445-bfa7-6b7370587841 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.508101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-70582421-b840-4445-bfa7-6b7370587841 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:30.647356 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-70582421-b840-4445-bfa7-6b7370587841 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:30.654966 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-70582421-b840-4445-bfa7-6b7370587841 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1443 microversion: 2.1 time: 0.159722 Jun 16 12:01:30.655526 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 397/766] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:30 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:30.913028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e8417cb4-b965-459d-8839-9d5690dc258d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:30.913644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e8417cb4-b965-459d-8839-9d5690dc258d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:30.920104 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8417cb4-b965-459d-8839-9d5690dc258d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.920546 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8417cb4-b965-459d-8839-9d5690dc258d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:30.921305 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8417cb4-b965-459d-8839-9d5690dc258d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:30.921740 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8417cb4-b965-459d-8839-9d5690dc258d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:31.111491 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:31.112262 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: a0cfe043-70c3-4137-b979-cfab2e3c1bab] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:31.118843 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:31.119292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:31.120100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:31.121155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:31.132610 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e8417cb4-b965-459d-8839-9d5690dc258d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:31.135010 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] HTTP exception thrown: Instance a0cfe043-70c3-4137-b979-cfab2e3c1bab could not be found. Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Request method failure captured: Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab HTTP/1.1 Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpc5yamDpiSB8f7OnESQ50cHNirlCnyBfPHjqjB2vSHropmWxfJeAbxensZSeje0UBxZtS1HNRcfksjlI8EJUoG4R3_riom8WCNK9__EeEp9jMVJvO38Uq6nurzXiWCO-8HNMoTEdxp17CohHT0K0EyN4HbiE1r6_iJ8WtFdSM9gGI Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:01:31.136764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 6cdd0a7f3f12414ea85ebffc9d531773 Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance a0cfe043-70c3-4137-b979-cfab2e3c1bab could not be found. Jun 16 12:01:31.138358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'a0cfe043-70c3-4137-b979-cfab2e3c1bab'} Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0cfe043-70c3-4137-b979-cfab2e3c1bab could not be found. Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:31.154787 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0cfe043-70c3-4137-b979-cfab2e3c1bab could not be found. Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0cfe043-70c3-4137-b979-cfab2e3c1bab could not be found. Jun 16 12:01:31.156475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:31.157839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Returning 404 to user: Instance a0cfe043-70c3-4137-b979-cfab2e3c1bab could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:31.157839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4eb23d14-ff46-4b69-bf43-6421f34955a2 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab" status: 404 len: 111 microversion: 2.1 time: 0.031187 Jun 16 12:01:31.157839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 398/767] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:31 2022] GET /compute/v2.1/servers/a0cfe043-70c3-4137-b979-cfab2e3c1bab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:01:31.158093 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e8417cb4-b965-459d-8839-9d5690dc258d tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.238194 Jun 16 12:01:31.158093 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 370/768] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:30 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:31.158258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e96f7732-014c-4ed1-bd98-c3f0a6129a3f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:31.158258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e96f7732-014c-4ed1-bd98-c3f0a6129a3f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:31.158258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e96f7732-014c-4ed1-bd98-c3f0a6129a3f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:31.158258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e96f7732-014c-4ed1-bd98-c3f0a6129a3f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:31.158591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e96f7732-014c-4ed1-bd98-c3f0a6129a3f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:31.158591 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e96f7732-014c-4ed1-bd98-c3f0a6129a3f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:31.184311 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e96f7732-014c-4ed1-bd98-c3f0a6129a3f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:01:31.498327 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e96f7732-014c-4ed1-bd98-c3f0a6129a3f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 204 len: 0 microversion: 2.1 time: 0.355235 Jun 16 12:01:31.498912 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 399/769] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:01:31 2022] DELETE /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 12:01:31.507625 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-098717f2-0173-4980-b73e-832cfa62b10f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:31.508972 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-098717f2-0173-4980-b73e-832cfa62b10f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:31.517188 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-098717f2-0173-4980-b73e-832cfa62b10f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:31.518157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-098717f2-0173-4980-b73e-832cfa62b10f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:31.519483 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-098717f2-0173-4980-b73e-832cfa62b10f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:31.520474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-098717f2-0173-4980-b73e-832cfa62b10f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:32.008441 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-098717f2-0173-4980-b73e-832cfa62b10f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:32.017209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-098717f2-0173-4980-b73e-832cfa62b10f tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.513834 Jun 16 12:01:32.018040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 371/770] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:31 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:32.163087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d09e73be-4450-48e6-be44-99068dc51e5a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:32.163854 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d09e73be-4450-48e6-be44-99068dc51e5a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:32.170436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d09e73be-4450-48e6-be44-99068dc51e5a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:32.171126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d09e73be-4450-48e6-be44-99068dc51e5a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:32.172144 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d09e73be-4450-48e6-be44-99068dc51e5a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:32.172583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d09e73be-4450-48e6-be44-99068dc51e5a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:32.304112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d09e73be-4450-48e6-be44-99068dc51e5a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:32.312641 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d09e73be-4450-48e6-be44-99068dc51e5a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.153826 Jun 16 12:01:32.322382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 400/771] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:32 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:32.348277 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-a71bf9ee-e056-4356-a6fd-8ef5d5386e95 req-5dc0ea67-6bdf-4d33-99aa-1c592897bb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d2914d-7d2a-4623-b9c1-3b0752478f96", "name": "network-vif-plugged", "status": "completed", "tag": "0a6d60f9-c7ff-43a6-8e1e-5247b2c29563"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:32.356971 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-a71bf9ee-e056-4356-a6fd-8ef5d5386e95 req-5dc0ea67-6bdf-4d33-99aa-1c592897bb2d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:32.357611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-a71bf9ee-e056-4356-a6fd-8ef5d5386e95 req-5dc0ea67-6bdf-4d33-99aa-1c592897bb2d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:32.368765 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-a71bf9ee-e056-4356-a6fd-8ef5d5386e95 req-5dc0ea67-6bdf-4d33-99aa-1c592897bb2d service nova] Creating event network-vif-plugged:0a6d60f9-c7ff-43a6-8e1e-5247b2c29563 for instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 on hv-cinder-84614 Jun 16 12:01:32.374134 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-a71bf9ee-e056-4356-a6fd-8ef5d5386e95 req-5dc0ea67-6bdf-4d33-99aa-1c592897bb2d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029756 Jun 16 12:01:32.374738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 372/772] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:33.034676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4afce672-b520-4fe1-a87b-546b4bd7d302 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:33.035286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4afce672-b520-4fe1-a87b-546b4bd7d302 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:33.041665 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4afce672-b520-4fe1-a87b-546b4bd7d302 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:33.043265 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4afce672-b520-4fe1-a87b-546b4bd7d302 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:33.044086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4afce672-b520-4fe1-a87b-546b4bd7d302 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:33.044539 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4afce672-b520-4fe1-a87b-546b4bd7d302 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:33.048541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-7a93459c-898c-495d-b409-d270a25aaee8 req-8cc8f0a1-c363-4c3c-b800-b7f7515365a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b481fc54-9d0a-4ce3-a4f8-651a22d1d276", "tag": "7856f81f-be70-45db-80ed-79a45bca3b14"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:33.067128 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-7a93459c-898c-495d-b409-d270a25aaee8 req-8cc8f0a1-c363-4c3c-b800-b7f7515365a7 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:33.067572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-7a93459c-898c-495d-b409-d270a25aaee8 req-8cc8f0a1-c363-4c3c-b800-b7f7515365a7 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:33.085966 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-7a93459c-898c-495d-b409-d270a25aaee8 req-8cc8f0a1-c363-4c3c-b800-b7f7515365a7 service nova] Creating event network-changed:7856f81f-be70-45db-80ed-79a45bca3b14 for instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 on hv-cinder-84614 Jun 16 12:01:33.093918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-7a93459c-898c-495d-b409-d270a25aaee8 req-8cc8f0a1-c363-4c3c-b800-b7f7515365a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049153 Jun 16 12:01:33.094709 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 373/773] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:01:33.200088 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4afce672-b520-4fe1-a87b-546b4bd7d302 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:33.207687 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4afce672-b520-4fe1-a87b-546b4bd7d302 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.177034 Jun 16 12:01:33.208286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 401/774] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:33 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:33.330284 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5970572a-7374-43f4-ac32-964abca0356e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:33.331003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5970572a-7374-43f4-ac32-964abca0356e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:33.337111 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5970572a-7374-43f4-ac32-964abca0356e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:33.337552 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5970572a-7374-43f4-ac32-964abca0356e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:33.338315 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5970572a-7374-43f4-ac32-964abca0356e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:33.338742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5970572a-7374-43f4-ac32-964abca0356e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:33.471467 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5970572a-7374-43f4-ac32-964abca0356e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:33.478822 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5970572a-7374-43f4-ac32-964abca0356e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.152885 Jun 16 12:01:33.479392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 374/775] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:33 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:34.225036 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-eef3bffe-43ed-4594-bbe9-e113c9d61f27 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:34.225581 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-eef3bffe-43ed-4594-bbe9-e113c9d61f27 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:34.232510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eef3bffe-43ed-4594-bbe9-e113c9d61f27 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:34.232952 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eef3bffe-43ed-4594-bbe9-e113c9d61f27 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:34.233708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eef3bffe-43ed-4594-bbe9-e113c9d61f27 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:34.234142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eef3bffe-43ed-4594-bbe9-e113c9d61f27 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:34.360379 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-eef3bffe-43ed-4594-bbe9-e113c9d61f27 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:34.367707 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-eef3bffe-43ed-4594-bbe9-e113c9d61f27 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.146868 Jun 16 12:01:34.368289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 402/776] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:34 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:34.496187 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-19c71bd6-67f5-4d9c-b5ff-045f28b6c266 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:34.496720 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-19c71bd6-67f5-4d9c-b5ff-045f28b6c266 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:34.503113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-19c71bd6-67f5-4d9c-b5ff-045f28b6c266 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:34.503547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-19c71bd6-67f5-4d9c-b5ff-045f28b6c266 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:34.504320 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-19c71bd6-67f5-4d9c-b5ff-045f28b6c266 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:34.504744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-19c71bd6-67f5-4d9c-b5ff-045f28b6c266 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:34.629202 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-19c71bd6-67f5-4d9c-b5ff-045f28b6c266 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:34.636511 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-19c71bd6-67f5-4d9c-b5ff-045f28b6c266 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.144840 Jun 16 12:01:34.637067 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 375/777] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:34 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:35.384292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-718af915-8acb-41e1-911a-d96a225a2b49 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:35.384924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-718af915-8acb-41e1-911a-d96a225a2b49 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:35.391994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-718af915-8acb-41e1-911a-d96a225a2b49 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:35.392445 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-718af915-8acb-41e1-911a-d96a225a2b49 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:35.393210 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-718af915-8acb-41e1-911a-d96a225a2b49 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:35.393676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-718af915-8acb-41e1-911a-d96a225a2b49 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:35.521114 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-718af915-8acb-41e1-911a-d96a225a2b49 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:35.528778 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-718af915-8acb-41e1-911a-d96a225a2b49 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.148284 Jun 16 12:01:35.529352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 403/778] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:35 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:35.653877 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7e61eb99-b799-4b39-a4a8-733389d06856 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:35.654516 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7e61eb99-b799-4b39-a4a8-733389d06856 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:35.661255 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7e61eb99-b799-4b39-a4a8-733389d06856 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:35.662126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7e61eb99-b799-4b39-a4a8-733389d06856 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:35.662904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7e61eb99-b799-4b39-a4a8-733389d06856 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:35.663398 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7e61eb99-b799-4b39-a4a8-733389d06856 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:35.861600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7e61eb99-b799-4b39-a4a8-733389d06856 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:35.869769 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7e61eb99-b799-4b39-a4a8-733389d06856 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.219837 Jun 16 12:01:35.870959 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 376/779] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:35 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:36.544973 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-afa80187-8fdc-46fa-bb54-e0ababc51cd5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:36.545698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-afa80187-8fdc-46fa-bb54-e0ababc51cd5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:36.552563 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-afa80187-8fdc-46fa-bb54-e0ababc51cd5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:36.553086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-afa80187-8fdc-46fa-bb54-e0ababc51cd5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:36.553920 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-afa80187-8fdc-46fa-bb54-e0ababc51cd5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:36.554419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-afa80187-8fdc-46fa-bb54-e0ababc51cd5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:36.684142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-afa80187-8fdc-46fa-bb54-e0ababc51cd5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:36.691568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-afa80187-8fdc-46fa-bb54-e0ababc51cd5 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1522 microversion: 2.1 time: 0.150637 Jun 16 12:01:36.692155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 404/780] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:36 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:36.887149 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e1d13663-30bb-4884-906b-b6abbaf8294c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:36.887765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e1d13663-30bb-4884-906b-b6abbaf8294c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:36.894228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e1d13663-30bb-4884-906b-b6abbaf8294c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:36.894715 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e1d13663-30bb-4884-906b-b6abbaf8294c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:36.895489 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e1d13663-30bb-4884-906b-b6abbaf8294c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:36.895945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e1d13663-30bb-4884-906b-b6abbaf8294c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:36.902950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-37a8ed3e-9cbc-43cf-9f1d-912acfb58932 req-5272fdfb-1e31-4544-ab41-8db00d5c4da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8294f9b2-7466-4a10-b810-dcc3515bb498", "name": "network-vif-deleted", "tag": "2df61128-89ae-431f-93db-63b6038696a5"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:36.911385 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-37a8ed3e-9cbc-43cf-9f1d-912acfb58932 req-5272fdfb-1e31-4544-ab41-8db00d5c4da0 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:36.911934 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-37a8ed3e-9cbc-43cf-9f1d-912acfb58932 req-5272fdfb-1e31-4544-ab41-8db00d5c4da0 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:36.924592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-37a8ed3e-9cbc-43cf-9f1d-912acfb58932 req-5272fdfb-1e31-4544-ab41-8db00d5c4da0 service nova] Creating event network-vif-deleted:2df61128-89ae-431f-93db-63b6038696a5 for instance 8294f9b2-7466-4a10-b810-dcc3515bb498 on hv-cinder-84614 Jun 16 12:01:36.929394 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-37a8ed3e-9cbc-43cf-9f1d-912acfb58932 req-5272fdfb-1e31-4544-ab41-8db00d5c4da0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089902 Jun 16 12:01:36.929986 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 377/781] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:37.037905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e1d13663-30bb-4884-906b-b6abbaf8294c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:37.041123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:37.045451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e1d13663-30bb-4884-906b-b6abbaf8294c tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.162854 Jun 16 12:01:37.046064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 405/782] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:36 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:37.408764 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1056823362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1690805727", "security_groups": [{"name": "tempest-secgroup-smoke-1884746139"}], "block_device_mapping_v2": [{"uuid": "8752edc7-535e-4d22-9cd2-c8410da73792", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a6f2fc51-0593-4393-8bad-bf4f67840cba"}]}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:37.531269 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] validate_networks() for [('a6f2fc51-0593-4393-8bad-bf4f67840cba', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:01:37.708690 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:37.709292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:37.716957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:37.717399 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:37.718246 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:37.719017 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:37.750525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:37.750971 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:37.751408 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'fault' on Instance uuid 8294f9b2-7466-4a10-b810-dcc3515bb498 {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:37.792534 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:37.800022 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-15a31fe2-4ae4-4c34-89ba-4b1a3aa38b93 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1312 microversion: 2.1 time: 0.095124 Jun 16 12:01:37.800583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 406/783] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:37 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:37.940322 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:01:37.940839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:01:37.941181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:01:37.941574 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:01:37.941968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:01:37.951916 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:37.952346 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:37.953127 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:37.953552 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:37.970547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Getting quotas for project 4be7fa7276cb42d3a8b6dd0dd12cd784. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:01:37.974678 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Getting quotas for user f6e726651e4c49b794f5c86e1fe51d9c and project 4be7fa7276cb42d3a8b6dd0dd12cd784. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:01:38.030890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:01:38.033163 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8752edc7-535e-4d22-9cd2-c8410da73792',volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:01:38.062605 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f1782cb8-787e-4251-8c6e-22e583211615 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:38.063215 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f1782cb8-787e-4251-8c6e-22e583211615 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:38.069225 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1782cb8-787e-4251-8c6e-22e583211615 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:38.069667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1782cb8-787e-4251-8c6e-22e583211615 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:38.070616 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1782cb8-787e-4251-8c6e-22e583211615 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:38.071301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1782cb8-787e-4251-8c6e-22e583211615 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:38.199810 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f1782cb8-787e-4251-8c6e-22e583211615 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:38.207269 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f1782cb8-787e-4251-8c6e-22e583211615 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.148772 Jun 16 12:01:38.207845 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 407/784] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:38 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:38.498968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8024f57e-f1f1-4153-b65b-02c4dd497fc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.094311 Jun 16 12:01:38.499601 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 378/785] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:01:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:01:38.509571 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e7940927-be3e-4335-b67c-2e0892bcd174 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:38.510176 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e7940927-be3e-4335-b67c-2e0892bcd174 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:38.564257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e7940927-be3e-4335-b67c-2e0892bcd174 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:38.571200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e7940927-be3e-4335-b67c-2e0892bcd174 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1095 microversion: 2.1 time: 0.065461 Jun 16 12:01:38.571765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 408/786] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:38 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:38.816382 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:38.816890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:38.823323 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:38.823771 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:38.824538 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:38.824962 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:38.856337 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:38.856772 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:38.857205 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'fault' on Instance uuid 8294f9b2-7466-4a10-b810-dcc3515bb498 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:38.898836 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:38.906249 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b9caa8e3-26e5-4694-af8c-e2ccd9516d55 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1312 microversion: 2.1 time: 0.093838 Jun 16 12:01:38.906813 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 379/787] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:38 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:39.224398 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-18dfdae6-19a3-405d-866a-5475ec5aa96a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:39.225039 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-18dfdae6-19a3-405d-866a-5475ec5aa96a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:39.232247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-18dfdae6-19a3-405d-866a-5475ec5aa96a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:39.232691 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-18dfdae6-19a3-405d-866a-5475ec5aa96a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:39.233450 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-18dfdae6-19a3-405d-866a-5475ec5aa96a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:39.233890 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-18dfdae6-19a3-405d-866a-5475ec5aa96a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:39.363774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-18dfdae6-19a3-405d-866a-5475ec5aa96a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:39.371529 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-18dfdae6-19a3-405d-866a-5475ec5aa96a tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.151282 Jun 16 12:01:39.372123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 409/788] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:39 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:39.588257 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-28784fbe-c59f-493a-b488-fe91a9535e8b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:39.589499 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-28784fbe-c59f-493a-b488-fe91a9535e8b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:39.595468 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28784fbe-c59f-493a-b488-fe91a9535e8b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:39.596192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28784fbe-c59f-493a-b488-fe91a9535e8b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:39.596940 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28784fbe-c59f-493a-b488-fe91a9535e8b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:39.597364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28784fbe-c59f-493a-b488-fe91a9535e8b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:39.601290 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:39.656449 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-28784fbe-c59f-493a-b488-fe91a9535e8b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:39.663609 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-28784fbe-c59f-493a-b488-fe91a9535e8b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1145 microversion: 2.1 time: 0.079098 Jun 16 12:01:39.664200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 380/789] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:39 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:39.922483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:39.923015 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:39.924928 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:39.929717 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:39.930204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:39.932173 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:39.932173 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:39.963133 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:39.963575 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:39.964053 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'fault' on Instance uuid 8294f9b2-7466-4a10-b810-dcc3515bb498 {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:40.003822 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:40.012609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f8b373ef-31b3-4ae8-a1aa-768f7014cf92 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1312 microversion: 2.1 time: 0.094037 Jun 16 12:01:40.013163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 410/790] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:39 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:40.387854 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2ed615d1-07cf-4d5b-98af-b291f29109b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:40.388487 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2ed615d1-07cf-4d5b-98af-b291f29109b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:40.395556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2ed615d1-07cf-4d5b-98af-b291f29109b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:40.396030 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2ed615d1-07cf-4d5b-98af-b291f29109b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:40.396780 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2ed615d1-07cf-4d5b-98af-b291f29109b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:40.397213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2ed615d1-07cf-4d5b-98af-b291f29109b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:40.529081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2ed615d1-07cf-4d5b-98af-b291f29109b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:40.537047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2ed615d1-07cf-4d5b-98af-b291f29109b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1363 microversion: 2.1 time: 0.152953 Jun 16 12:01:40.537528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 381/791] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:40 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:40.680172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7c73ce1d-3e50-4c98-8d93-898a10ddb452 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:40.680720 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7c73ce1d-3e50-4c98-8d93-898a10ddb452 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:40.687714 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7c73ce1d-3e50-4c98-8d93-898a10ddb452 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:40.688194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7c73ce1d-3e50-4c98-8d93-898a10ddb452 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:40.688956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7c73ce1d-3e50-4c98-8d93-898a10ddb452 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:40.689386 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7c73ce1d-3e50-4c98-8d93-898a10ddb452 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:40.748678 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7c73ce1d-3e50-4c98-8d93-898a10ddb452 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:40.756059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7c73ce1d-3e50-4c98-8d93-898a10ddb452 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1145 microversion: 2.1 time: 0.079795 Jun 16 12:01:40.756627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 411/792] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:40 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:41.029138 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:41.029746 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:41.035785 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.036252 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.036999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.037421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.067322 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.067757 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.068223 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lazy-loading 'fault' on Instance uuid 8294f9b2-7466-4a10-b810-dcc3515bb498 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:41.110202 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdd0a7f3f12414ea85ebffc9d531773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5409289ccf4aad8d62b13a72d0009e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:41.118005 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ba751d23-9bb8-4e58-a09d-e4336e7065e6 tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 200 len: 1312 microversion: 2.1 time: 0.093328 Jun 16 12:01:41.118569 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 382/793] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:41 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:41.554622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-752ddd81-49a1-4cb5-8fa3-aab25b147a61 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:41.555410 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-752ddd81-49a1-4cb5-8fa3-aab25b147a61 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:41.562849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-752ddd81-49a1-4cb5-8fa3-aab25b147a61 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.563278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-752ddd81-49a1-4cb5-8fa3-aab25b147a61 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.564190 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-752ddd81-49a1-4cb5-8fa3-aab25b147a61 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.564626 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-752ddd81-49a1-4cb5-8fa3-aab25b147a61 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.701612 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-752ddd81-49a1-4cb5-8fa3-aab25b147a61 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:41.709263 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-752ddd81-49a1-4cb5-8fa3-aab25b147a61 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1550 microversion: 2.1 time: 0.158607 Jun 16 12:01:41.709825 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 412/794] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:41 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:41.725778 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-accfff11-fd91-4a35-9455-c7c05e4ce122 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:41.726274 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-accfff11-fd91-4a35-9455-c7c05e4ce122 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:41.733523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-accfff11-fd91-4a35-9455-c7c05e4ce122 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.734055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-accfff11-fd91-4a35-9455-c7c05e4ce122 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.734844 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-accfff11-fd91-4a35-9455-c7c05e4ce122 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.735293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-accfff11-fd91-4a35-9455-c7c05e4ce122 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.772414 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e597826d-9dee-410e-aaa6-2447f463ec8c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:41.773026 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e597826d-9dee-410e-aaa6-2447f463ec8c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:41.779259 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e597826d-9dee-410e-aaa6-2447f463ec8c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.779711 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e597826d-9dee-410e-aaa6-2447f463ec8c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.780518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e597826d-9dee-410e-aaa6-2447f463ec8c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:41.780957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e597826d-9dee-410e-aaa6-2447f463ec8c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:41.813530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-accfff11-fd91-4a35-9455-c7c05e4ce122 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091758 Jun 16 12:01:41.814202 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 383/795] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 12:01:41 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:41.842235 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e597826d-9dee-410e-aaa6-2447f463ec8c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:41.850085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e597826d-9dee-410e-aaa6-2447f463ec8c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1193 microversion: 2.1 time: 0.081674 Jun 16 12:01:41.850692 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 413/796] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:41 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:42.134615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:42.135287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] [instance: 8294f9b2-7466-4a10-b810-dcc3515bb498] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:42.142392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:42.142982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:42.143760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:42.144206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:42.158723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] HTTP exception thrown: Instance 8294f9b2-7466-4a10-b810-dcc3515bb498 could not be found. Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Request method failure captured: Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 HTTP/1.1 Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpc5yamDpiSB8f7OnESQ50cHNirlCnyBfPHjqjB2vSHropmWxfJeAbxensZSeje0UBxZtS1HNRcfksjlI8EJUoG4R3_riom8WCNK9__EeEp9jMVJvO38Uq6nurzXiWCO-8HNMoTEdxp17CohHT0K0EyN4HbiE1r6_iJ8WtFdSM9gGI Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:01:42.160472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce5409289ccf4aad8d62b13a72d0009e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: ce5409289ccf4aad8d62b13a72d0009e Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507409529 Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 6cdd0a7f3f12414ea85ebffc9d531773 Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507409529-project Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 8294f9b2-7466-4a10-b810-dcc3515bb498 could not be found. Jun 16 12:01:42.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '8294f9b2-7466-4a10-b810-dcc3515bb498'} Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8294f9b2-7466-4a10-b810-dcc3515bb498 could not be found. Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:42.165613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8294f9b2-7466-4a10-b810-dcc3515bb498 could not be found. Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8294f9b2-7466-4a10-b810-dcc3515bb498 could not be found. Jun 16 12:01:42.167615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:42.169045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] Returning 404 to user: Instance 8294f9b2-7466-4a10-b810-dcc3515bb498 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:42.169045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9ba3e61f-3aaf-495a-ac88-6d48cf2ec43d tempest-ServerRescueNegativeTestJSON-1507409529 tempest-ServerRescueNegativeTestJSON-1507409529-project] 10.222.0.40 "GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498" status: 404 len: 111 microversion: 2.1 time: 0.031181 Jun 16 12:01:42.169045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 384/797] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:42 2022] GET /compute/v2.1/servers/8294f9b2-7466-4a10-b810-dcc3515bb498 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:01:42.868238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e43c8d79-828f-4508-998d-c71bfa8ec539 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:42.869563 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e43c8d79-828f-4508-998d-c71bfa8ec539 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:42.876912 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e43c8d79-828f-4508-998d-c71bfa8ec539 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:42.877574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e43c8d79-828f-4508-998d-c71bfa8ec539 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:42.878515 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e43c8d79-828f-4508-998d-c71bfa8ec539 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:42.879117 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e43c8d79-828f-4508-998d-c71bfa8ec539 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:42.982508 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e43c8d79-828f-4508-998d-c71bfa8ec539 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:42.990612 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e43c8d79-828f-4508-998d-c71bfa8ec539 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1211 microversion: 2.1 time: 0.126444 Jun 16 12:01:42.991407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 414/798] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:42 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:43.404206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-65ec0d6e-9aa8-48a5-9721-fa76f552a7a9 req-ddaa8525-52ac-4bec-bf3a-f9ba33f564ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d2914d-7d2a-4623-b9c1-3b0752478f96", "tag": "0a6d60f9-c7ff-43a6-8e1e-5247b2c29563"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:43.417686 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-65ec0d6e-9aa8-48a5-9721-fa76f552a7a9 req-ddaa8525-52ac-4bec-bf3a-f9ba33f564ba service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:43.418204 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-65ec0d6e-9aa8-48a5-9721-fa76f552a7a9 req-ddaa8525-52ac-4bec-bf3a-f9ba33f564ba service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:43.433368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-65ec0d6e-9aa8-48a5-9721-fa76f552a7a9 req-ddaa8525-52ac-4bec-bf3a-f9ba33f564ba service nova] Creating event network-changed:0a6d60f9-c7ff-43a6-8e1e-5247b2c29563 for instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 on hv-cinder-84614 Jun 16 12:01:43.439819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-65ec0d6e-9aa8-48a5-9721-fa76f552a7a9 req-ddaa8525-52ac-4bec-bf3a-f9ba33f564ba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040211 Jun 16 12:01:43.441442 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 385/799] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:44.014094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ce8355da-1cb2-427e-97cc-0fe816a86141 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:44.015306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ce8355da-1cb2-427e-97cc-0fe816a86141 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:44.027705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce8355da-1cb2-427e-97cc-0fe816a86141 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:44.028701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce8355da-1cb2-427e-97cc-0fe816a86141 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:44.031044 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce8355da-1cb2-427e-97cc-0fe816a86141 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:44.031699 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce8355da-1cb2-427e-97cc-0fe816a86141 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:44.332112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ce8355da-1cb2-427e-97cc-0fe816a86141 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:44.340583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ce8355da-1cb2-427e-97cc-0fe816a86141 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.330803 Jun 16 12:01:44.341664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 415/800] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:44 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:45.241418 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3de9ac86-dfca-4666-af64-507e9c325499 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:45.242068 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3de9ac86-dfca-4666-af64-507e9c325499 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:45.249561 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3de9ac86-dfca-4666-af64-507e9c325499 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:45.250080 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3de9ac86-dfca-4666-af64-507e9c325499 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:45.250930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3de9ac86-dfca-4666-af64-507e9c325499 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:45.251582 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3de9ac86-dfca-4666-af64-507e9c325499 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:45.348349 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-3de9ac86-dfca-4666-af64-507e9c325499 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lazy-loading 'services' on Instance uuid 0fd54546-c04b-4baa-be84-8b3db4c724fc {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:45.358335 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d1462fed-65c4-485d-a4f5-98739ed62546 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:45.359548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d1462fed-65c4-485d-a4f5-98739ed62546 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:45.370806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d1462fed-65c4-485d-a4f5-98739ed62546 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:45.373630 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d1462fed-65c4-485d-a4f5-98739ed62546 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:45.374643 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d1462fed-65c4-485d-a4f5-98739ed62546 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:45.375259 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d1462fed-65c4-485d-a4f5-98739ed62546 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:45.618998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d1462fed-65c4-485d-a4f5-98739ed62546 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:45.626674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d1462fed-65c4-485d-a4f5-98739ed62546 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.272675 Jun 16 12:01:45.627478 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 416/801] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:45 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:45.632424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-f695e050-6e9d-40b6-bcef-659b32ae50d9 req-24443396-bd28-4aa9-b230-10c1e4d51a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a1b425-5720-4f35-ad2e-89ae357c62c5", "tag": "7f468ee4-db76-4173-bece-42f1456f6426"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:45.641077 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-f695e050-6e9d-40b6-bcef-659b32ae50d9 req-24443396-bd28-4aa9-b230-10c1e4d51a67 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:45.641648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-f695e050-6e9d-40b6-bcef-659b32ae50d9 req-24443396-bd28-4aa9-b230-10c1e4d51a67 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:45.655105 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-f695e050-6e9d-40b6-bcef-659b32ae50d9 req-24443396-bd28-4aa9-b230-10c1e4d51a67 service nova] Creating event network-changed:7f468ee4-db76-4173-bece-42f1456f6426 for instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 on hv-cinder-84614 Jun 16 12:01:45.668186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-f695e050-6e9d-40b6-bcef-659b32ae50d9 req-24443396-bd28-4aa9-b230-10c1e4d51a67 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039235 Jun 16 12:01:45.668820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 417/802] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:45.676090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3de9ac86-dfca-4666-af64-507e9c325499 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc/os-volume_attachments/c4f5d642-267c-4943-85e2-401cf7462cce" status: 202 len: 0 microversion: 2.1 time: 0.438481 Jun 16 12:01:45.679211 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 386/803] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:01:45 2022] DELETE /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc/os-volume_attachments/c4f5d642-267c-4943-85e2-401cf7462cce => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:01:46.645288 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d980ef23-687b-4906-a825-62719a72d87c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:46.646612 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d980ef23-687b-4906-a825-62719a72d87c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:46.653872 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d980ef23-687b-4906-a825-62719a72d87c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:46.654323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d980ef23-687b-4906-a825-62719a72d87c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:46.655330 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d980ef23-687b-4906-a825-62719a72d87c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:46.655964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d980ef23-687b-4906-a825-62719a72d87c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:46.843009 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d980ef23-687b-4906-a825-62719a72d87c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:46.850898 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d980ef23-687b-4906-a825-62719a72d87c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.210448 Jun 16 12:01:46.851460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 418/804] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:46 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:47.868640 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3170022a-9d36-4315-80d7-bf4555ce9eb3 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:47.869404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3170022a-9d36-4315-80d7-bf4555ce9eb3 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:47.877250 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3170022a-9d36-4315-80d7-bf4555ce9eb3 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:47.877780 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3170022a-9d36-4315-80d7-bf4555ce9eb3 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:47.878617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3170022a-9d36-4315-80d7-bf4555ce9eb3 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:47.879271 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3170022a-9d36-4315-80d7-bf4555ce9eb3 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:47.885928 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f21fdf73-56c6-4c78-94da-b4b5aaa85bc7 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:47.886626 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f21fdf73-56c6-4c78-94da-b4b5aaa85bc7 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:47.894000 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f21fdf73-56c6-4c78-94da-b4b5aaa85bc7 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:47.894696 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f21fdf73-56c6-4c78-94da-b4b5aaa85bc7 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:47.895502 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f21fdf73-56c6-4c78-94da-b4b5aaa85bc7 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:47.895957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f21fdf73-56c6-4c78-94da-b4b5aaa85bc7 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:47.925007 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f21fdf73-56c6-4c78-94da-b4b5aaa85bc7 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:01:47.963452 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:47.981455 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=6 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:48.020057 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3170022a-9d36-4315-80d7-bf4555ce9eb3 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:48.028586 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3170022a-9d36-4315-80d7-bf4555ce9eb3 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.163907 Jun 16 12:01:48.029170 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 387/805] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:47 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:48.224022 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f21fdf73-56c6-4c78-94da-b4b5aaa85bc7 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 204 len: 0 microversion: 2.1 time: 0.347872 Jun 16 12:01:48.224613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 419/806] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:01:47 2022] DELETE /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 12:01:48.236028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1fa6ce38-6f56-40a2-92ec-c6077db4a0de tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:48.236028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1fa6ce38-6f56-40a2-92ec-c6077db4a0de tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:48.240688 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1fa6ce38-6f56-40a2-92ec-c6077db4a0de tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:48.241128 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1fa6ce38-6f56-40a2-92ec-c6077db4a0de tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:48.241909 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1fa6ce38-6f56-40a2-92ec-c6077db4a0de tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:48.242331 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1fa6ce38-6f56-40a2-92ec-c6077db4a0de tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:48.380351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1fa6ce38-6f56-40a2-92ec-c6077db4a0de tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:48.388553 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1fa6ce38-6f56-40a2-92ec-c6077db4a0de tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1514 microversion: 2.1 time: 0.159779 Jun 16 12:01:48.389365 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 388/807] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:48 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:48.461051 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-607e93ec-1215-4114-8bbc-3e4667196bca tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Action: 'create', calling method: .version_select at 0x7f4334305160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-930202548"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:48.568675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:49.045029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1d15f42f-1a48-457c-8c59-d3464f1fedb0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:49.045634 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1d15f42f-1a48-457c-8c59-d3464f1fedb0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:49.052011 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1d15f42f-1a48-457c-8c59-d3464f1fedb0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:49.052450 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1d15f42f-1a48-457c-8c59-d3464f1fedb0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:49.053195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1d15f42f-1a48-457c-8c59-d3464f1fedb0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:49.053618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1d15f42f-1a48-457c-8c59-d3464f1fedb0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:49.063858 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-607e93ec-1215-4114-8bbc-3e4667196bca tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.716789 Jun 16 12:01:49.064513 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 420/808] 10.222.0.40 () {60 vars in 1154 bytes} [Thu Jun 16 12:01:48 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 719 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 12:01:49.075705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1d819c22-2c2d-4729-99ca-719a4252ba3e tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f43342a9670>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:49.132111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1d819c22-2c2d-4729-99ca-719a4252ba3e tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df" status: 200 len: 344 microversion: 2.1 time: 0.060608 Jun 16 12:01:49.132998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 421/809] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 12:01:49 2022] GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:01:49.188202 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1d15f42f-1a48-457c-8c59-d3464f1fedb0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:49.195472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1d15f42f-1a48-457c-8c59-d3464f1fedb0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.154342 Jun 16 12:01:49.196054 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 389/810] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:49 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:49.405441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cf463808-8f6c-46d9-a1b0-90efafcc1a92 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:49.406089 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cf463808-8f6c-46d9-a1b0-90efafcc1a92 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:49.412391 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf463808-8f6c-46d9-a1b0-90efafcc1a92 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:49.412832 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf463808-8f6c-46d9-a1b0-90efafcc1a92 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:49.413585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf463808-8f6c-46d9-a1b0-90efafcc1a92 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:49.414015 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cf463808-8f6c-46d9-a1b0-90efafcc1a92 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:49.545457 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cf463808-8f6c-46d9-a1b0-90efafcc1a92 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:49.553295 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cf463808-8f6c-46d9-a1b0-90efafcc1a92 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1514 microversion: 2.1 time: 0.151838 Jun 16 12:01:49.553864 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 422/811] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:49 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:50.145174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-429b8a8e-e104-47b1-97a1-263aeb039d02 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f43342883a0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:50.192124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-429b8a8e-e104-47b1-97a1-263aeb039d02 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df" status: 200 len: 345 microversion: 2.1 time: 0.050751 Jun 16 12:01:50.192694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 390/812] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 12:01:50 2022] GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:50.204235 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bdfd1a07-2793-413a-a3e4-caf4cbbd6391 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Action: 'create', calling method: .version_select at 0x7f4334159c10>, body: {"snapshot": {"volume_id": "b01a376c-7f9d-47a1-802b-272e2c6450df", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1621459593"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:50.211634 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-88bc92ca-8f0c-4d3c-9bc4-a3c6538384d1 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:50.212292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-88bc92ca-8f0c-4d3c-9bc4-a3c6538384d1 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:50.219656 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-88bc92ca-8f0c-4d3c-9bc4-a3c6538384d1 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:50.219656 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-88bc92ca-8f0c-4d3c-9bc4-a3c6538384d1 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:50.220416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-88bc92ca-8f0c-4d3c-9bc4-a3c6538384d1 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:50.220848 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-88bc92ca-8f0c-4d3c-9bc4-a3c6538384d1 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:50.433551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-88bc92ca-8f0c-4d3c-9bc4-a3c6538384d1 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:50.441893 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-88bc92ca-8f0c-4d3c-9bc4-a3c6538384d1 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.233895 Jun 16 12:01:50.442877 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 391/813] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:50 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:50.569613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-51db677e-e8d3-40c6-b6ab-462b8d4fa87b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:50.570216 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-51db677e-e8d3-40c6-b6ab-462b8d4fa87b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:50.576633 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-51db677e-e8d3-40c6-b6ab-462b8d4fa87b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:50.577069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-51db677e-e8d3-40c6-b6ab-462b8d4fa87b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:50.577818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-51db677e-e8d3-40c6-b6ab-462b8d4fa87b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:50.578242 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-51db677e-e8d3-40c6-b6ab-462b8d4fa87b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:50.639669 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bdfd1a07-2793-413a-a3e4-caf4cbbd6391 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.439135 Jun 16 12:01:50.655596 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 423/814] 10.222.0.40 () {60 vars in 1161 bytes} [Thu Jun 16 12:01:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:50.668991 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d40e9054-dcaa-4a3f-b3ce-32c0480d9ad4 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f43342a98b0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:50.713998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d40e9054-dcaa-4a3f-b3ce-32c0480d9ad4 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a" status: 200 len: 287 microversion: 2.1 time: 0.049447 Jun 16 12:01:50.714568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 424/815] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 12:01:50 2022] GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:50.725229 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7e3f34aa-e7d7-405a-a42c-76b8413a2f7b tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f433434a670>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:50.759813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7e3f34aa-e7d7-405a-a42c-76b8413a2f7b tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039459 Jun 16 12:01:50.763402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 425/816] 10.222.0.40 () {58 vars in 1139 bytes} [Thu Jun 16 12:01:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:01:50.770606 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7b866625-5f2d-4cca-9949-23c571715b56 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f433434ae50>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:50.800993 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7b866625-5f2d-4cca-9949-23c571715b56 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a" status: 200 len: 287 microversion: 2.1 time: 0.034141 Jun 16 12:01:50.801651 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 426/817] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 12:01:50 2022] GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:51.012110 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-d707a5a4-80a7-4f55-b01f-f1b9101c76fb req-70d7e587-393b-4923-9718-0901f5b1ea4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd54546-c04b-4baa-be84-8b3db4c724fc", "name": "network-vif-deleted", "tag": "bb4fb330-aa18-4a4a-8209-5d2e1df86614"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:51.020544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-d707a5a4-80a7-4f55-b01f-f1b9101c76fb req-70d7e587-393b-4923-9718-0901f5b1ea4e service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:51.021063 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-d707a5a4-80a7-4f55-b01f-f1b9101c76fb req-70d7e587-393b-4923-9718-0901f5b1ea4e service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:51.028745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-51db677e-e8d3-40c6-b6ab-462b8d4fa87b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:51.032348 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-d707a5a4-80a7-4f55-b01f-f1b9101c76fb req-70d7e587-393b-4923-9718-0901f5b1ea4e service nova] Creating event network-vif-deleted:bb4fb330-aa18-4a4a-8209-5d2e1df86614 for instance 0fd54546-c04b-4baa-be84-8b3db4c724fc on hv-cinder-84614 Jun 16 12:01:51.037180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-d707a5a4-80a7-4f55-b01f-f1b9101c76fb req-70d7e587-393b-4923-9718-0901f5b1ea4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028800 Jun 16 12:01:51.037751 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 427/818] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:51.037856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-51db677e-e8d3-40c6-b6ab-462b8d4fa87b tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1514 microversion: 2.1 time: 0.471907 Jun 16 12:01:51.038408 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 392/819] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:50 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1514 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:01:51.459299 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-66712e8f-9ee3-4b4f-afb4-19e6fdc6c319 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:51.460031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-66712e8f-9ee3-4b4f-afb4-19e6fdc6c319 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:51.467021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-66712e8f-9ee3-4b4f-afb4-19e6fdc6c319 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:51.467466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-66712e8f-9ee3-4b4f-afb4-19e6fdc6c319 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:51.468269 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-66712e8f-9ee3-4b4f-afb4-19e6fdc6c319 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:51.468708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-66712e8f-9ee3-4b4f-afb4-19e6fdc6c319 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:51.486548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:51.597645 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-66712e8f-9ee3-4b4f-afb4-19e6fdc6c319 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:51.604983 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-66712e8f-9ee3-4b4f-afb4-19e6fdc6c319 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.150420 Jun 16 12:01:51.608669 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 428/820] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:51 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:51.813131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5e47d080-64cf-41f1-882b-1a392329dec2 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f4334263a60>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:51.842637 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5e47d080-64cf-41f1-882b-1a392329dec2 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a" status: 200 len: 287 microversion: 2.1 time: 0.033308 Jun 16 12:01:51.843180 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 393/821] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 12:01:51 2022] GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:52.056155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e3d994f4-14ff-467f-8394-51278299b716 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:52.056777 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e3d994f4-14ff-467f-8394-51278299b716 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:52.063514 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e3d994f4-14ff-467f-8394-51278299b716 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:52.063941 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e3d994f4-14ff-467f-8394-51278299b716 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:52.064734 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e3d994f4-14ff-467f-8394-51278299b716 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:52.065174 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e3d994f4-14ff-467f-8394-51278299b716 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:52.125526 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e3d994f4-14ff-467f-8394-51278299b716 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:52.132992 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e3d994f4-14ff-467f-8394-51278299b716 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1472 microversion: 2.1 time: 0.081086 Jun 16 12:01:52.133564 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 429/822] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:52 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1472 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:52.628565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-13b3050b-af7a-48e6-8e9b-dc7e8fd07a09 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:52.628565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-13b3050b-af7a-48e6-8e9b-dc7e8fd07a09 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:52.628565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13b3050b-af7a-48e6-8e9b-dc7e8fd07a09 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:52.628946 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13b3050b-af7a-48e6-8e9b-dc7e8fd07a09 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:52.629523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13b3050b-af7a-48e6-8e9b-dc7e8fd07a09 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:52.629958 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-13b3050b-af7a-48e6-8e9b-dc7e8fd07a09 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:52.758627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-13b3050b-af7a-48e6-8e9b-dc7e8fd07a09 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:52.766127 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-13b3050b-af7a-48e6-8e9b-dc7e8fd07a09 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.148433 Jun 16 12:01:52.766685 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 394/823] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:52 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:52.854879 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-14063e10-ef04-4ae6-a309-907a08e20b5e tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f433426aca0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:52.883811 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-14063e10-ef04-4ae6-a309-907a08e20b5e tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a" status: 200 len: 287 microversion: 2.1 time: 0.033275 Jun 16 12:01:52.884405 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 430/824] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 12:01:52 2022] GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:53.150536 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6d4a0f09-b5c5-488a-8808-07fcbf9644dd tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:53.151055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6d4a0f09-b5c5-488a-8808-07fcbf9644dd tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:53.158221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d4a0f09-b5c5-488a-8808-07fcbf9644dd tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:53.158665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d4a0f09-b5c5-488a-8808-07fcbf9644dd tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:53.159415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d4a0f09-b5c5-488a-8808-07fcbf9644dd tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:53.159840 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d4a0f09-b5c5-488a-8808-07fcbf9644dd tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:53.225370 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6d4a0f09-b5c5-488a-8808-07fcbf9644dd tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:53.232873 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6d4a0f09-b5c5-488a-8808-07fcbf9644dd tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1472 microversion: 2.1 time: 0.086325 Jun 16 12:01:53.233433 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 395/825] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:53 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:53.782910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-21d3d1d5-7232-40d0-8922-b6291a3f3d4f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:53.783850 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-21d3d1d5-7232-40d0-8922-b6291a3f3d4f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:53.789747 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-21d3d1d5-7232-40d0-8922-b6291a3f3d4f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:53.794194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-21d3d1d5-7232-40d0-8922-b6291a3f3d4f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:53.794194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-21d3d1d5-7232-40d0-8922-b6291a3f3d4f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:53.794194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-21d3d1d5-7232-40d0-8922-b6291a3f3d4f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:53.896063 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1ad6904c-b943-4103-9c43-535805dc5ecb tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f433429edc0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:53.926395 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1ad6904c-b943-4103-9c43-535805dc5ecb tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a" status: 200 len: 288 microversion: 2.1 time: 0.034158 Jun 16 12:01:53.926599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-21d3d1d5-7232-40d0-8922-b6291a3f3d4f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:53.927063 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 396/826] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 12:01:53 2022] GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:01:53.934696 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-21d3d1d5-7232-40d0-8922-b6291a3f3d4f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.155806 Jun 16 12:01:53.935248 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 431/827] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:53 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:53.937796 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-68368fe0-80dd-4e57-ae13-0e309f9b42b1 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f43342e8ee0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:54.057303 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-68368fe0-80dd-4e57-ae13-0e309f9b42b1 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a" status: 202 len: 0 microversion: 2.1 time: 0.123400 Jun 16 12:01:54.057868 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 397/828] 10.222.0.40 () {58 vars in 1253 bytes} [Thu Jun 16 12:01:53 2022] DELETE /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 12:01:54.066082 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-466b4c24-9f0a-488e-954d-2f44262eab5f tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f43342790d0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:54.095786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-466b4c24-9f0a-488e-954d-2f44262eab5f tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a" status: 200 len: 287 microversion: 2.1 time: 0.033628 Jun 16 12:01:54.096661 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 432/829] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 12:01:54 2022] GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:54.250189 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:54.250797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:54.257325 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:54.257763 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:54.258515 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:54.258941 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:54.288859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:54.289279 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:54.289718 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lazy-loading 'fault' on Instance uuid 0fd54546-c04b-4baa-be84-8b3db4c724fc {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:01:54.329494 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e69fc12fcc34fa39f67dd156cd860a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c80e6e109741d1bd83c7b81368a87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:54.336885 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-858ff2c1-fe8e-4fda-a6d1-e1e818c0d0c8 tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 200 len: 1309 microversion: 2.1 time: 0.091020 Jun 16 12:01:54.337445 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 398/830] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:54 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:54.953048 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1f0311df-9812-46b9-9244-5d7edb4e72cb tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:54.953852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-1f0311df-9812-46b9-9244-5d7edb4e72cb tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:54.960007 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1f0311df-9812-46b9-9244-5d7edb4e72cb tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:54.960450 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1f0311df-9812-46b9-9244-5d7edb4e72cb tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:54.961218 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1f0311df-9812-46b9-9244-5d7edb4e72cb tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:54.961658 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1f0311df-9812-46b9-9244-5d7edb4e72cb tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:55.092980 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1f0311df-9812-46b9-9244-5d7edb4e72cb tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:55.100757 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1f0311df-9812-46b9-9244-5d7edb4e72cb tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.152956 Jun 16 12:01:55.101315 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 433/831] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:54 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:55.107732 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-25d6a0b8-f652-48d5-9bb7-e73ab7d40852 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f433429edc0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:55.133113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-25d6a0b8-f652-48d5-9bb7-e73ab7d40852 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] HTTP exception thrown: Snapshot f41187f7-14c4-4a91-a786-93216c44092a could not be found. Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-25d6a0b8-f652-48d5-9bb7-e73ab7d40852 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Request method failure captured: Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a HTTP/1.1 Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxusySEucaFeFLaxGkDc7QUFCTT8fV9o65JSZ-44XnyqAluMAf-ChiSPbR-al_8MOUxKmjxEez-sD9XdujaPRUEostbxqLg72NRXFdIyxJwp_cz6OXuY9qexaFBn-j1w9V75cBCEAup5PmK-xsUfTGeL8At9vcZg-LKqAFNmM8eNOyE Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: fd9a1d686d0f4a59817e2a94e58ab120 Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:01:55.136209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: fd9a1d686d0f4a59817e2a94e58ab120 Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesSnapshotsTestJSON-224517838-project Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: a28ec3b323ae437b9154a6ba98d8439c Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesSnapshotsTestJSON-224517838-project Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Snapshot f41187f7-14c4-4a91-a786-93216c44092a could not be found. Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': 'f41187f7-14c4-4a91-a786-93216c44092a'} Jun 16 12:01:55.137661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f41187f7-14c4-4a91-a786-93216c44092a could not be found. (HTTP 404) (Request-ID: req-a296f52c-9a26-4d38-9bdc-5ad5ca8d45a9) Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.138645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:01:55.139839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f41187f7-14c4-4a91-a786-93216c44092a could not be found. Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 12:01:55.141049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f41187f7-14c4-4a91-a786-93216c44092a could not be found. Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f41187f7-14c4-4a91-a786-93216c44092a could not be found. Jun 16 12:01:55.142270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.143831 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-25d6a0b8-f652-48d5-9bb7-e73ab7d40852 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Returning 404 to user: Snapshot f41187f7-14c4-4a91-a786-93216c44092a could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:55.144705 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-25d6a0b8-f652-48d5-9bb7-e73ab7d40852 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a" status: 404 len: 111 microversion: 2.1 time: 0.040925 Jun 16 12:01:55.145291 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 399/832] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 12:01:55 2022] GET /compute/v2.1/os-snapshots/f41187f7-14c4-4a91-a786-93216c44092a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:01:55.157934 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a0de2af0-e03e-496f-8738-713935841c76 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f433437e9d0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:55.326103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a0de2af0-e03e-496f-8738-713935841c76 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df" status: 202 len: 0 microversion: 2.1 time: 0.171916 Jun 16 12:01:55.330200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 434/833] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 12:01:55 2022] DELETE /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:01:55.335339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-25942717-7cb0-461d-95ca-32d55f3aa7a4 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f4334263550>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:55.356514 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:55.357129 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] [instance: 0fd54546-c04b-4baa-be84-8b3db4c724fc] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:55.363288 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:55.363733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:55.364893 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:55.365131 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:55.380117 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] HTTP exception thrown: Instance 0fd54546-c04b-4baa-be84-8b3db4c724fc could not be found. Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Request method failure captured: Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc HTTP/1.1 Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxsmQFqHn3AA8eR6ae1dcpMAcDJGtNQ38SHlH5x0Xm_wPzgqXiazC1Fgmwd923bPj24wbtU0ECrU4qodEeVV4ZUvx7g9eLc-DgQ5U5u_8b_fUOQzBcwT5nIjgZf6re5jr9pVcRbHZgIU1lxr2q4h3f3R3UhG1SQK5bvHVab8QuJaTgQ Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 82c80e6e109741d1bd83c7b81368a87f Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-VolumesSnapshotTestJSON-177579902 Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:01:55.382228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/82c80e6e109741d1bd83c7b81368a87f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_82c80e6e109741d1bd83c7b81368a87f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82c80e6e109741d1bd83c7b81368a87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82c80e6e109741d1bd83c7b81368a87f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-VolumesSnapshotTestJSON-177579902 Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 82c80e6e109741d1bd83c7b81368a87f Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-177579902 Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-VolumesSnapshotTestJSON-177579902-project Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 5e69fc12fcc34fa39f67dd156cd860a4 Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-VolumesSnapshotTestJSON-177579902-project Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 0fd54546-c04b-4baa-be84-8b3db4c724fc could not be found. Jun 16 12:01:55.383773 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '0fd54546-c04b-4baa-be84-8b3db4c724fc'} Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd54546-c04b-4baa-be84-8b3db4c724fc could not be found. Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:55.384905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd54546-c04b-4baa-be84-8b3db4c724fc could not be found. Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd54546-c04b-4baa-be84-8b3db4c724fc could not be found. Jun 16 12:01:55.386351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:55.387542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-25942717-7cb0-461d-95ca-32d55f3aa7a4 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df" status: 200 len: 344 microversion: 2.1 time: 0.055308 Jun 16 12:01:55.387542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 400/834] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 12:01:55 2022] GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:55.388388 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] Returning 404 to user: Instance 0fd54546-c04b-4baa-be84-8b3db4c724fc could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:55.389634 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-deb9a519-2a45-45b8-a27c-bbf605f2e2df tempest-VolumesSnapshotTestJSON-177579902 tempest-VolumesSnapshotTestJSON-177579902-project] 10.222.0.40 "GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc" status: 404 len: 111 microversion: 2.1 time: 0.037305 Jun 16 12:01:55.393069 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 435/835] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:55 2022] GET /compute/v2.1/servers/0fd54546-c04b-4baa-be84-8b3db4c724fc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:01:56.117860 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d90d7947-71c7-4c2c-95dc-75f5c06917ff tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:56.118465 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d90d7947-71c7-4c2c-95dc-75f5c06917ff tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:56.124799 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d90d7947-71c7-4c2c-95dc-75f5c06917ff tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:56.125237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d90d7947-71c7-4c2c-95dc-75f5c06917ff tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:56.126045 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d90d7947-71c7-4c2c-95dc-75f5c06917ff tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:56.126417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d90d7947-71c7-4c2c-95dc-75f5c06917ff tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:56.254654 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d90d7947-71c7-4c2c-95dc-75f5c06917ff tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:56.262662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d90d7947-71c7-4c2c-95dc-75f5c06917ff tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.148786 Jun 16 12:01:56.263231 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 401/836] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:56 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:56.398986 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f0f7ca89-1d16-450e-badb-18379cb1b42b tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f433437e940>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:56.427953 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-f0f7ca89-1d16-450e-badb-18379cb1b42b tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] HTTP exception thrown: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f0f7ca89-1d16-450e-badb-18379cb1b42b tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Request method failure captured: Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df HTTP/1.1 Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxusySEucaFeFLaxGkDc7QUFCTT8fV9o65JSZ-44XnyqAluMAf-ChiSPbR-al_8MOUxKmjxEez-sD9XdujaPRUEostbxqLg72NRXFdIyxJwp_cz6OXuY9qexaFBn-j1w9V75cBCEAup5PmK-xsUfTGeL8At9vcZg-LKqAFNmM8eNOyE Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: fd9a1d686d0f4a59817e2a94e58ab120 Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:01:56.431172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: fd9a1d686d0f4a59817e2a94e58ab120 Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-VolumesSnapshotsTestJSON-224517838-project Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: a28ec3b323ae437b9154a6ba98d8439c Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-VolumesSnapshotsTestJSON-224517838-project Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'b01a376c-7f9d-47a1-802b-272e2c6450df'} Jun 16 12:01:56.433214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. (HTTP 404) (Request-ID: req-00e3131f-4836-45c9-8439-d932190cc1e7) Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.434205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:01:56.435551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 12:01:56.437469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f0f7ca89-1d16-450e-badb-18379cb1b42b tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Returning 404 to user: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f0f7ca89-1d16-450e-badb-18379cb1b42b tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df" status: 404 len: 109 microversion: 2.1 time: 0.038333 Jun 16 12:01:56.438791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 436/837] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 12:01:56 2022] GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:01:56.447047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7a791fb1-5957-4665-a5b5-564d92455b81 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f4334302b80>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:56.475124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-7a791fb1-5957-4665-a5b5-564d92455b81 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] HTTP exception thrown: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7a791fb1-5957-4665-a5b5-564d92455b81 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Request method failure captured: Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: DELETE /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df HTTP/1.1 Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxusySEucaFeFLaxGkDc7QUFCTT8fV9o65JSZ-44XnyqAluMAf-ChiSPbR-al_8MOUxKmjxEez-sD9XdujaPRUEostbxqLg72NRXFdIyxJwp_cz6OXuY9qexaFBn-j1w9V75cBCEAup5PmK-xsUfTGeL8At9vcZg-LKqAFNmM8eNOyE Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: fd9a1d686d0f4a59817e2a94e58ab120 Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:01:56.477046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: fd9a1d686d0f4a59817e2a94e58ab120 Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesSnapshotsTestJSON-224517838-project Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: a28ec3b323ae437b9154a6ba98d8439c Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesSnapshotsTestJSON-224517838-project Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': 'b01a376c-7f9d-47a1-802b-272e2c6450df'} Jun 16 12:01:56.480636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. (HTTP 404) (Request-ID: req-c8f453c3-d1d0-4113-8991-b526d341a2c7) Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.481784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:01:56.483200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 12:01:56.484843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7a791fb1-5957-4665-a5b5-564d92455b81 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Returning 404 to user: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7a791fb1-5957-4665-a5b5-564d92455b81 tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df" status: 404 len: 109 microversion: 2.1 time: 0.035152 Jun 16 12:01:56.486221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 402/838] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 12:01:56 2022] DELETE /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:01:56.488845 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-aee9cf07-e2a9-4ca5-a2fa-886f621d45ff tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Calling method '.version_select at 0x7f433429a310>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:56.516664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-aee9cf07-e2a9-4ca5-a2fa-886f621d45ff tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] HTTP exception thrown: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-aee9cf07-e2a9-4ca5-a2fa-886f621d45ff tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Request method failure captured: Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df HTTP/1.1 Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxusySEucaFeFLaxGkDc7QUFCTT8fV9o65JSZ-44XnyqAluMAf-ChiSPbR-al_8MOUxKmjxEez-sD9XdujaPRUEostbxqLg72NRXFdIyxJwp_cz6OXuY9qexaFBn-j1w9V75cBCEAup5PmK-xsUfTGeL8At9vcZg-LKqAFNmM8eNOyE Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: fd9a1d686d0f4a59817e2a94e58ab120 Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:01:56.518622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd9a1d686d0f4a59817e2a94e58ab120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: fd9a1d686d0f4a59817e2a94e58ab120 Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-224517838 Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-VolumesSnapshotsTestJSON-224517838-project Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: a28ec3b323ae437b9154a6ba98d8439c Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-VolumesSnapshotsTestJSON-224517838-project Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'b01a376c-7f9d-47a1-802b-272e2c6450df'} Jun 16 12:01:56.524664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. (HTTP 404) (Request-ID: req-2b39fecf-dbc2-48e4-adc5-c127f55375ae) Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.526094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:01:56.527448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 12:01:56.528851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-aee9cf07-e2a9-4ca5-a2fa-886f621d45ff tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] Returning 404 to user: Volume b01a376c-7f9d-47a1-802b-272e2c6450df could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-aee9cf07-e2a9-4ca5-a2fa-886f621d45ff tempest-VolumesSnapshotsTestJSON-224517838 tempest-VolumesSnapshotsTestJSON-224517838-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df" status: 404 len: 109 microversion: 2.1 time: 0.036539 Jun 16 12:01:56.530279 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 437/839] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 12:01:56 2022] GET /compute/v2.1/os-volumes/b01a376c-7f9d-47a1-802b-272e2c6450df => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:01:57.209829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-df6bbf08-0a79-4a8d-9e75-137cee9c8417 req-96f5847f-88eb-46f6-a295-6c62278bb3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a1b425-5720-4f35-ad2e-89ae357c62c5", "name": "network-vif-plugged", "status": "completed", "tag": "7f468ee4-db76-4173-bece-42f1456f6426"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:01:57.219323 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-df6bbf08-0a79-4a8d-9e75-137cee9c8417 req-96f5847f-88eb-46f6-a295-6c62278bb3ab service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:57.219760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-df6bbf08-0a79-4a8d-9e75-137cee9c8417 req-96f5847f-88eb-46f6-a295-6c62278bb3ab service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:57.233131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-df6bbf08-0a79-4a8d-9e75-137cee9c8417 req-96f5847f-88eb-46f6-a295-6c62278bb3ab service nova] Creating event network-vif-plugged:7f468ee4-db76-4173-bece-42f1456f6426 for instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 on hv-cinder-84614 Jun 16 12:01:57.238363 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-df6bbf08-0a79-4a8d-9e75-137cee9c8417 req-96f5847f-88eb-46f6-a295-6c62278bb3ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152481 Jun 16 12:01:57.238953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 403/840] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:01:57.279426 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-be305f42-29cd-4fac-bb24-04db884b4cd2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:57.280076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-be305f42-29cd-4fac-bb24-04db884b4cd2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:57.294622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-be305f42-29cd-4fac-bb24-04db884b4cd2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:57.295790 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-be305f42-29cd-4fac-bb24-04db884b4cd2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:57.297127 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-be305f42-29cd-4fac-bb24-04db884b4cd2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:57.297578 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-be305f42-29cd-4fac-bb24-04db884b4cd2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:57.479470 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-be305f42-29cd-4fac-bb24-04db884b4cd2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:57.487139 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-be305f42-29cd-4fac-bb24-04db884b4cd2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.212334 Jun 16 12:01:57.487697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 438/841] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:57 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:58.292116 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c22edc4d-d6d1-43a1-b45b-f9ec81fc6fba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:58.292728 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c22edc4d-d6d1-43a1-b45b-f9ec81fc6fba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:58.298978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c22edc4d-d6d1-43a1-b45b-f9ec81fc6fba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:58.299418 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c22edc4d-d6d1-43a1-b45b-f9ec81fc6fba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:58.300217 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c22edc4d-d6d1-43a1-b45b-f9ec81fc6fba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:58.300645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c22edc4d-d6d1-43a1-b45b-f9ec81fc6fba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:58.324134 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c22edc4d-d6d1-43a1-b45b-f9ec81fc6fba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/ips" status: 200 len: 151 microversion: 2.20 time: 0.263456 Jun 16 12:01:58.324636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 404/842] 10.222.0.40 () {60 vars in 1288 bytes} [Thu Jun 16 12:01:58 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/ips => generated 151 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:01:58.503286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-13574f54-9203-44d5-a8bf-7010abc80af6 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:58.503928 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-13574f54-9203-44d5-a8bf-7010abc80af6 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:58.510489 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-13574f54-9203-44d5-a8bf-7010abc80af6 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:58.510936 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-13574f54-9203-44d5-a8bf-7010abc80af6 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:58.511703 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-13574f54-9203-44d5-a8bf-7010abc80af6 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:58.512167 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-13574f54-9203-44d5-a8bf-7010abc80af6 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:58.656004 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-13574f54-9203-44d5-a8bf-7010abc80af6 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:58.663769 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-13574f54-9203-44d5-a8bf-7010abc80af6 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.164288 Jun 16 12:01:58.664375 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 439/843] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:58 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:01:59.680505 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ceeb7a7e-7596-49a1-99e0-7bfece236910 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:01:59.681036 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ceeb7a7e-7596-49a1-99e0-7bfece236910 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:01:59.687702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ceeb7a7e-7596-49a1-99e0-7bfece236910 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:59.688177 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ceeb7a7e-7596-49a1-99e0-7bfece236910 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:59.688952 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ceeb7a7e-7596-49a1-99e0-7bfece236910 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:01:59.689707 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ceeb7a7e-7596-49a1-99e0-7bfece236910 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:01:59.694008 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:59.826125 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ceeb7a7e-7596-49a1-99e0-7bfece236910 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:01:59.833607 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ceeb7a7e-7596-49a1-99e0-7bfece236910 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.157035 Jun 16 12:01:59.834169 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 405/844] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:01:59 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:02:00.851099 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4a6da7ce-7e88-4362-8a8f-fb50fa707821 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:00.851703 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4a6da7ce-7e88-4362-8a8f-fb50fa707821 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:00.858882 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a6da7ce-7e88-4362-8a8f-fb50fa707821 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:00.859324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a6da7ce-7e88-4362-8a8f-fb50fa707821 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:00.860114 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a6da7ce-7e88-4362-8a8f-fb50fa707821 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:00.860576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a6da7ce-7e88-4362-8a8f-fb50fa707821 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:00.993666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4a6da7ce-7e88-4362-8a8f-fb50fa707821 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:01.002341 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4a6da7ce-7e88-4362-8a8f-fb50fa707821 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1267 microversion: 2.1 time: 0.155687 Jun 16 12:02:01.002905 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 440/845] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:02:00 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:02:01.592693 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b0c22f61-194b-488b-a582-5fb166a2a494 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:01.594308 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b0c22f61-194b-488b-a582-5fb166a2a494 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:01.596925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:01.601782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b0c22f61-194b-488b-a582-5fb166a2a494 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:01.602231 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b0c22f61-194b-488b-a582-5fb166a2a494 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:01.602993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b0c22f61-194b-488b-a582-5fb166a2a494 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:01.603429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b0c22f61-194b-488b-a582-5fb166a2a494 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:01.625999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-b0c22f61-194b-488b-a582-5fb166a2a494 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lazy-loading 'flavor' on Instance uuid f92dcff2-3f99-42cc-ba24-52bc94d88986 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:02:02.019586 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4ba16601-9ce9-442d-8dca-d6755c7a851a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:02.020238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4ba16601-9ce9-442d-8dca-d6755c7a851a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:02.026909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4ba16601-9ce9-442d-8dca-d6755c7a851a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:02.027535 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4ba16601-9ce9-442d-8dca-d6755c7a851a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:02.028679 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4ba16601-9ce9-442d-8dca-d6755c7a851a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:02.029306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4ba16601-9ce9-442d-8dca-d6755c7a851a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:02.171509 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4ba16601-9ce9-442d-8dca-d6755c7a851a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:02.179562 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4ba16601-9ce9-442d-8dca-d6755c7a851a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1454 microversion: 2.1 time: 0.163902 Jun 16 12:02:02.180298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 441/846] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:02:02 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:02:02.199449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6013e250-05f6-476c-9a4f-0582f18dcfc0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:02.199449 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6013e250-05f6-476c-9a4f-0582f18dcfc0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:02.205424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6013e250-05f6-476c-9a4f-0582f18dcfc0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:02.205872 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6013e250-05f6-476c-9a4f-0582f18dcfc0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:02.206649 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6013e250-05f6-476c-9a4f-0582f18dcfc0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:02.207087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6013e250-05f6-476c-9a4f-0582f18dcfc0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:02.253024 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b0c22f61-194b-488b-a582-5fb166a2a494 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/action" status: 202 len: 0 microversion: 2.20 time: 0.664203 Jun 16 12:02:02.257272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 406/847] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jun 16 12:02:01 2022] POST /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:02:02.262767 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:02.268522 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:02.269967 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:02.270354 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:02.271112 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:02.271712 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:02.355988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6013e250-05f6-476c-9a4f-0582f18dcfc0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:02.363425 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6013e250-05f6-476c-9a4f-0582f18dcfc0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1454 microversion: 2.1 time: 0.170827 Jun 16 12:02:02.364092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 442/848] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:02:02 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:02:02.415581 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:02.425410 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:02.427141 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:02.428368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-63ae0a03-8ddf-438a-b1a2-6936ae588486 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.169704 Jun 16 12:02:02.428925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 407/849] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:02 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:03.446774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:03.447407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:03.460003 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:03.460003 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:03.460003 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:03.460003 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:03.890228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:03.899653 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:03.901297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:03.903318 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-da1aa488-7212-492c-90ca-2a67953e6133 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.460502 Jun 16 12:02:03.914613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 443/850] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:03 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:04.845748 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-50d7a70b-7642-436c-bbc1-7f4137e7094b req-3fbf0ee4-b76f-435e-b2f3-40abf81e46ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a1b425-5720-4f35-ad2e-89ae357c62c5", "tag": "7f468ee4-db76-4173-bece-42f1456f6426"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:04.853985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-50d7a70b-7642-436c-bbc1-7f4137e7094b req-3fbf0ee4-b76f-435e-b2f3-40abf81e46ac service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:04.854421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-50d7a70b-7642-436c-bbc1-7f4137e7094b req-3fbf0ee4-b76f-435e-b2f3-40abf81e46ac service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:04.866199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-50d7a70b-7642-436c-bbc1-7f4137e7094b req-3fbf0ee4-b76f-435e-b2f3-40abf81e46ac service nova] Creating event network-changed:7f468ee4-db76-4173-bece-42f1456f6426 for instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 on hv-cinder-84614 Jun 16 12:02:04.871063 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-50d7a70b-7642-436c-bbc1-7f4137e7094b req-3fbf0ee4-b76f-435e-b2f3-40abf81e46ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148031 Jun 16 12:02:04.871839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 408/851] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:02:04.922525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:04.923285 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:04.930090 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:04.930616 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:04.931589 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:04.932128 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:05.087359 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:05.097033 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:05.101510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:05.101510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3519d0c5-33d6-4219-8dcb-94b069893671 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.182934 Jun 16 12:02:05.112966 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 444/852] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:04 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:06.121122 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:06.121911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:06.128054 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:06.128493 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:06.129244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:06.129668 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:06.256154 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:06.264084 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:06.265556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:06.266683 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-41035d22-1551-4fe2-bd85-e80d7fbfe23c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.150442 Jun 16 12:02:06.267230 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 409/853] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:06 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:07.284938 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:07.285568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:07.291927 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:07.293001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:07.293760 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:07.294187 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:07.423080 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:07.430954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:07.432494 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:07.434343 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-09cf4613-389e-49bd-bb6c-63801a5db76b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.153251 Jun 16 12:02:07.434904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 445/854] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:07 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:08.453091 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:08.453813 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:08.460941 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:08.461502 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:08.462398 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:08.463066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:08.601690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:08.612345 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:08.613842 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:08.615051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-394ae5f0-b5be-4fd5-8e6a-9c41a3b348bd tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.166408 Jun 16 12:02:08.615609 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 410/855] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:08 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:09.634846 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:09.635448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:09.642676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:09.643195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:09.643990 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:09.644446 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:09.781456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:09.789406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:09.790900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:09.792144 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f5822ab0-1f86-49d9-b08e-06a5e9ec6d66 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.161239 Jun 16 12:02:09.792692 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 446/856] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:09 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:10.810622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:10.811253 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:10.817742 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:10.822551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:10.822551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:10.822551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:10.950494 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:10.958257 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:10.959729 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:10.960905 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-bf60ea55-8b2f-44c1-b13d-bc75c89ef714 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.154692 Jun 16 12:02:10.961454 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 411/857] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:10 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:11.980804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:11.981404 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:11.983763 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:11.988577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:11.989016 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:11.989800 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:11.990227 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:12.127530 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:12.135627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:12.137274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:12.138423 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-496530d6-9540-4562-b7e9-646b3ad0b88d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.162277 Jun 16 12:02:12.138968 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 447/858] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:11 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:13.156589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:13.157101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:13.163557 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:13.164029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:13.165539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:13.165539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:13.301650 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:13.310405 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:13.311922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:13.313091 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-782fd7bc-d8c4-4603-81f0-0a02dc9291fc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.160430 Jun 16 12:02:13.313647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 412/859] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:13 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:14.331545 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:14.332171 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:14.338648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:14.339048 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:14.339804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:14.340258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:14.485419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:14.498733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:14.503027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:14.504697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e89afea5-3f37-4aeb-b5ed-0a0e6125d17e tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.176916 Jun 16 12:02:14.505848 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 448/860] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:14 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:15.523879 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:15.524440 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:15.531416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:15.531878 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:15.532625 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:15.533049 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:15.679064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:15.688012 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:15.689995 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:15.691167 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d60a5114-655b-4ed4-ada1-265ed3b7291c tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.171249 Jun 16 12:02:15.691721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 413/861] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:15 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:16.709762 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:16.710363 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:16.717403 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:16.717845 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:16.718609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:16.719042 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:16.852013 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:16.860708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:16.862203 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:16.863384 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-85855686-3f15-458f-b988-908668576e1f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.157883 Jun 16 12:02:16.863959 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 449/862] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:16 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:02:17.882416 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:17.883139 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:17.890202 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:17.894426 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:17.894426 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:17.894426 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:18.029259 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:18.040114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:18.042993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:18.044239 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d48f691a-82b9-4013-a95d-09d001c36337 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.166005 Jun 16 12:02:18.047730 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 414/863] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:17 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:19.063029 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:19.063613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:19.069761 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:19.070187 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:19.070946 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:19.071376 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:19.201656 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:19.204987 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=100 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:19.209708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:19.211617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:19.212413 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c4d03587-bd25-4b0b-ae07-84238b569637 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.153305 Jun 16 12:02:19.212961 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 450/864] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:19 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:20.230536 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:20.232325 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:20.239025 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:20.239464 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:20.240267 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:20.240691 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:20.417107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:20.425105 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:20.426600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:20.427747 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-648478bd-e4e1-4b84-815f-3fbf330294ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.201191 Jun 16 12:02:20.428344 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 415/865] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:20 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:21.445935 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:21.446567 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:21.454150 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:21.454599 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:21.455470 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:21.456000 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:21.627831 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:21.641286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:21.642957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:21.644514 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-112abafd-2f80-4210-972d-0eed102cbac9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.202530 Jun 16 12:02:21.645025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 451/866] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:21 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:22.662913 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:22.663532 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:22.670976 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:22.671413 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:22.672195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:22.672621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:22.806215 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:22.815694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:22.817360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:22.818517 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d243f613-6505-4320-bc41-6002fbdf00d0 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.159536 Jun 16 12:02:22.829648 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 416/867] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:22 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:23.837209 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:23.838207 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:23.844751 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:23.845419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:23.846257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:23.846961 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:23.988629 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:23.996826 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:23.998546 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:23.999728 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ceb1a23e-df36-42b3-b459-132da47fa2b4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1744 microversion: 2.20 time: 0.166495 Jun 16 12:02:24.000308 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 452/868] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:23 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:25.018431 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:25.018950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:25.025473 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:25.025916 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:25.026702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:25.027128 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:25.173748 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:25.183977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:25.185544 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:25.186766 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-40b0081f-7279-4ba7-b26d-c2c290143b6d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1744 microversion: 2.20 time: 0.172279 Jun 16 12:02:25.187330 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 417/869] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:25 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:26.205520 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:26.206143 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:26.212496 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:26.213302 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:26.213674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:26.214034 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:26.353000 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:26.361815 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:26.363318 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:26.364510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-707b1cfd-1b79-4ce8-bf41-cba3f7924768 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.162966 Jun 16 12:02:26.365081 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 453/870] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:26 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:27.249117 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-61fa1e2f-0207-48da-9572-6d0361fc9386 req-bec03287-94c6-470e-898b-5bcd9d38b42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92dcff2-3f99-42cc-ba24-52bc94d88986", "name": "network-vif-plugged", "status": "completed", "tag": "7a3bc920-a057-45f1-b3ee-bc1f2c74986b"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:27.259535 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-61fa1e2f-0207-48da-9572-6d0361fc9386 req-bec03287-94c6-470e-898b-5bcd9d38b42a service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:27.260090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-61fa1e2f-0207-48da-9572-6d0361fc9386 req-bec03287-94c6-470e-898b-5bcd9d38b42a service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:27.274950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-61fa1e2f-0207-48da-9572-6d0361fc9386 req-bec03287-94c6-470e-898b-5bcd9d38b42a service nova] Creating event network-vif-plugged:7a3bc920-a057-45f1-b3ee-bc1f2c74986b for instance f92dcff2-3f99-42cc-ba24-52bc94d88986 on hv-cinder-84614 Jun 16 12:02:27.280461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-61fa1e2f-0207-48da-9572-6d0361fc9386 req-bec03287-94c6-470e-898b-5bcd9d38b42a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043687 Jun 16 12:02:27.281206 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 418/871] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:02:27.388352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:27.389153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:27.403748 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:27.404852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:27.407285 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:27.408623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:27.563756 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:27.578521 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:27.581180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:27.583031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-308fd62c-5d4f-4995-b313-6a9a4d8ddacc tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.199630 Jun 16 12:02:27.584511 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 454/872] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:27 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:28.162293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-23fbed7d-d0f7-4789-82ea-49f75244bedb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:28.163124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-23fbed7d-d0f7-4789-82ea-49f75244bedb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:28.170392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-23fbed7d-d0f7-4789-82ea-49f75244bedb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:28.171200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-23fbed7d-d0f7-4789-82ea-49f75244bedb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:28.172175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-23fbed7d-d0f7-4789-82ea-49f75244bedb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:28.172682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-23fbed7d-d0f7-4789-82ea-49f75244bedb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:28.206899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-23fbed7d-d0f7-4789-82ea-49f75244bedb tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/ips" status: 200 len: 147 microversion: 2.1 time: 0.048867 Jun 16 12:02:28.225680 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 419/873] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 12:02:28 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/ips => generated 147 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:02:28.601920 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:28.602635 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:28.611441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:28.612195 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:28.613146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:28.613767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:28.794370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:28.802680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:28.804278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:28.807613 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b00c9ce7-20ce-416e-82a1-e924d8a083e6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.209625 Jun 16 12:02:28.819238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 455/874] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:28 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:29.826956 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:29.827510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:29.833934 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:29.834378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:29.835131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:29.835585 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:29.838267 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:29.974370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-377a4c7e-a7a9-474f-871a-d7373dc933fe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8436fdf-ce94-43ae-bac1-b579c30c2dcf"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:29.976678 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-377a4c7e-a7a9-474f-871a-d7373dc933fe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:29.983205 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-377a4c7e-a7a9-474f-871a-d7373dc933fe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:29.984214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-377a4c7e-a7a9-474f-871a-d7373dc933fe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:29.985239 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-377a4c7e-a7a9-474f-871a-d7373dc933fe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:29.986040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-377a4c7e-a7a9-474f-871a-d7373dc933fe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:29.995019 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:30.003767 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:30.005294 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:30.006455 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ff6cc242-f6e7-4547-87a2-119100003ead tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.183926 Jun 16 12:02:30.007310 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 420/875] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:29 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:30.822126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-377a4c7e-a7a9-474f-871a-d7373dc933fe tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852040 Jun 16 12:02:30.823200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 456/876] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:02:29 2022] POST /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:02:31.028071 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:31.029397 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:31.037153 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:31.037664 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:31.038572 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:31.039088 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:31.203811 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:31.216531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:31.219046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:31.226354 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f468b3ca-a9f8-4fde-b5d4-a1d7103e2372 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.196815 Jun 16 12:02:31.226354 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 421/877] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:31 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:32.244506 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:32.246408 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:32.256957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:32.258823 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:32.258823 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:32.259028 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:32.422194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:32.431324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:32.434792 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:32.437402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-788a5bed-8a97-409d-895e-d8afedd7ad6a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.197923 Jun 16 12:02:32.438859 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 457/878] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:32 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:33.457821 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:33.459348 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:33.471464 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=32 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:33.473420 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:33.474134 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:33.475137 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:33.475789 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:33.642986 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:33.654264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:33.656118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:33.657520 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-50a56b00-5a29-4ec6-807b-0013d23343ab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.205576 Jun 16 12:02:33.658950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 422/879] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:33 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:34.680764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:34.681466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:34.691607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:34.692367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:34.694158 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:34.695254 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:34.858972 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:34.868359 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:34.871391 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:34.872875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8dc867a2-465f-44de-ba7f-f8df6b303084 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.200818 Jun 16 12:02:34.873954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 458/880] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:34 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:02:35.893022 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:35.893890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:35.903174 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:35.903671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:35.904540 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:35.905190 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:36.046443 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:36.055070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:36.056798 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:36.058562 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6d238cf6-4efa-4288-8372-d53886194c72 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.170095 Jun 16 12:02:36.059126 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 423/881] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:35 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:37.077683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:37.078236 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:37.084665 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:37.085110 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:37.085873 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:37.086306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:37.231301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:37.250557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:37.252297 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:37.253672 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-65f134be-0fd7-44e6-9271-193ec0471a70 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1739 microversion: 2.20 time: 0.180580 Jun 16 12:02:37.254693 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 459/882] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:37 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:38.272954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:38.273561 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:38.280375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:38.280831 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:38.281575 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:38.281999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:38.420101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a3927551-755c-4ac7-9548-43b344ae4b89 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:38.421027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a3927551-755c-4ac7-9548-43b344ae4b89 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:38.428855 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a3927551-755c-4ac7-9548-43b344ae4b89 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:38.428855 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a3927551-755c-4ac7-9548-43b344ae4b89 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:38.429603 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a3927551-755c-4ac7-9548-43b344ae4b89 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:38.430067 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a3927551-755c-4ac7-9548-43b344ae4b89 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:38.461627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a3927551-755c-4ac7-9548-43b344ae4b89 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Jun 16 12:02:38.462256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 460/883] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:02:38 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:02:38.472316 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-17b4bbfc-7ca8-49c4-92a1-3f309fa46ac5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:38.472806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-17b4bbfc-7ca8-49c4-92a1-3f309fa46ac5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:38.475064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:38.479025 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17b4bbfc-7ca8-49c4-92a1-3f309fa46ac5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:38.479469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17b4bbfc-7ca8-49c4-92a1-3f309fa46ac5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:38.480332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17b4bbfc-7ca8-49c4-92a1-3f309fa46ac5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:38.480765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17b4bbfc-7ca8-49c4-92a1-3f309fa46ac5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:38.484076 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:38.485964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:38.487326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f93db6fd-f897-40c5-a0e4-23532d42599f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1721 microversion: 2.20 time: 0.218504 Jun 16 12:02:38.488614 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 424/884] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:38 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:38.511520 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-17b4bbfc-7ca8-49c4-92a1-3f309fa46ac5 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/e8436fdf-ce94-43ae-bac1-b579c30c2dcf" status: 200 len: 194 microversion: 2.1 time: 0.042706 Jun 16 12:02:38.512144 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 461/885] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jun 16 12:02:38 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/e8436fdf-ce94-43ae-bac1-b579c30c2dcf => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:02:39.508773 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:39.509391 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:39.516258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:39.516703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:39.517510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:39.517964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:39.651415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:39.659947 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:39.667029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:39.667029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-33badff8-d62b-48de-b8e4-421c3c01ad51 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1721 microversion: 2.20 time: 0.157879 Jun 16 12:02:39.667029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 425/886] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:39 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:40.109981 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-62704dbe-5da6-4caf-97bc-e4544a2bde93 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd162583-27dd-419e-bc64-5a7c86324e30"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:40.111045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-62704dbe-5da6-4caf-97bc-e4544a2bde93 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:40.117586 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-62704dbe-5da6-4caf-97bc-e4544a2bde93 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:40.119044 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-62704dbe-5da6-4caf-97bc-e4544a2bde93 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:40.119044 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-62704dbe-5da6-4caf-97bc-e4544a2bde93 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:40.119348 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-62704dbe-5da6-4caf-97bc-e4544a2bde93 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:40.684902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:40.685518 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:40.692693 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:40.693142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:40.693904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:40.694329 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:40.827413 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-62704dbe-5da6-4caf-97bc-e4544a2bde93 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "POST /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721710 Jun 16 12:02:40.828273 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 462/887] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:02:40 2022] POST /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:02:40.831836 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:40.841037 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:40.842811 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:40.844038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4cb7fe27-2c28-4e96-b369-2230d733c59d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1724 microversion: 2.20 time: 0.163054 Jun 16 12:02:40.851906 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 426/888] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:40 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:40.862522 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ad1477ff-9c1d-4643-b7d8-d70fe60ccba6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b31f61c0-be9d-4cc2-88ab-290beb462375"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:40.863728 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ad1477ff-9c1d-4643-b7d8-d70fe60ccba6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:40.870450 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad1477ff-9c1d-4643-b7d8-d70fe60ccba6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:40.870952 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad1477ff-9c1d-4643-b7d8-d70fe60ccba6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:40.871793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad1477ff-9c1d-4643-b7d8-d70fe60ccba6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:40.872171 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad1477ff-9c1d-4643-b7d8-d70fe60ccba6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:41.227139 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-d507506f-29b8-403a-b376-a5e080807bd4 req-47bc2d7d-f9a1-41b4-b548-cac5afbefbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92dcff2-3f99-42cc-ba24-52bc94d88986", "name": "network-vif-unplugged", "status": "completed", "tag": "7a3bc920-a057-45f1-b3ee-bc1f2c74986b"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:41.236092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-d507506f-29b8-403a-b376-a5e080807bd4 req-47bc2d7d-f9a1-41b4-b548-cac5afbefbe1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:41.236527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-d507506f-29b8-403a-b376-a5e080807bd4 req-47bc2d7d-f9a1-41b4-b548-cac5afbefbe1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:41.247421 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.compute.server_external_events [req-d507506f-29b8-403a-b376-a5e080807bd4 req-47bc2d7d-f9a1-41b4-b548-cac5afbefbe1 service nova] Unable to find a host for instance f92dcff2-3f99-42cc-ba24-52bc94d88986. Dropping event network-vif-unplugged {{(pid=125055) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 12:02:41.248292 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-d507506f-29b8-403a-b376-a5e080807bd4 req-47bc2d7d-f9a1-41b4-b548-cac5afbefbe1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024995 Jun 16 12:02:41.248847 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 427/889] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 12:02:41.515185 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:42.008091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ad1477ff-9c1d-4643-b7d8-d70fe60ccba6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.146447 Jun 16 12:02:42.008091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 463/890] 10.222.0.40 () {62 vars in 1363 bytes} [Thu Jun 16 12:02:40 2022] POST /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/os-volume_attachments => generated 188 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:02:42.127739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-313e5022-cc52-4710-a2f3-a0c1495b4348 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:42.128264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-313e5022-cc52-4710-a2f3-a0c1495b4348 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:42.134620 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-313e5022-cc52-4710-a2f3-a0c1495b4348 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:42.135058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-313e5022-cc52-4710-a2f3-a0c1495b4348 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:42.135810 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-313e5022-cc52-4710-a2f3-a0c1495b4348 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:42.136258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-313e5022-cc52-4710-a2f3-a0c1495b4348 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:42.850839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-313e5022-cc52-4710-a2f3-a0c1495b4348 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/os-volume_attachments/b31f61c0-be9d-4cc2-88ab-290beb462375" status: 202 len: 0 microversion: 2.20 time: 0.727247 Jun 16 12:02:42.851427 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 428/891] 10.222.0.40 () {60 vars in 1456 bytes} [Thu Jun 16 12:02:42 2022] DELETE /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/os-volume_attachments/b31f61c0-be9d-4cc2-88ab-290beb462375 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:02:42.907181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ac66f85c-74a7-4eba-867a-9abafe83abc6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:42.907736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ac66f85c-74a7-4eba-867a-9abafe83abc6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:42.910095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=34 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:42.915322 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ac66f85c-74a7-4eba-867a-9abafe83abc6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:42.915765 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ac66f85c-74a7-4eba-867a-9abafe83abc6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:42.916549 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ac66f85c-74a7-4eba-867a-9abafe83abc6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:42.917008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ac66f85c-74a7-4eba-867a-9abafe83abc6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:43.110393 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ac66f85c-74a7-4eba-867a-9abafe83abc6 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "POST /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/action" status: 202 len: 0 microversion: 2.20 time: 0.207248 Jun 16 12:02:43.111106 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 464/892] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jun 16 12:02:42 2022] POST /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:02:43.119596 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:43.120620 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:43.127796 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:43.129078 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:43.129879 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:43.130384 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:43.280510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:43.287842 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:43.289665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:43.290820 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-319923e6-2eb0-42bd-8d2e-2d66df940d3f tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1672 microversion: 2.20 time: 0.175529 Jun 16 12:02:43.291405 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 429/893] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:43 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:44.309958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:44.310722 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:44.318234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:44.318786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:44.319941 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:44.320679 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:44.454818 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:44.462745 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:44.464937 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:44.466288 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-97194e7e-9988-4201-9655-c2f1a1768900 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1674 microversion: 2.20 time: 0.160929 Jun 16 12:02:44.467012 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 465/894] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:44 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:45.485701 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:45.486307 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:45.492927 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:45.493367 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:45.494127 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:45.494560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:45.653132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:45.662028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:45.663661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:45.664851 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0c436939-8766-4156-922b-556ec8ae2e6b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.183195 Jun 16 12:02:45.665566 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 430/895] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:45 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:46.685586 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:46.686806 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:46.693962 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:46.694522 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:46.695493 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:46.696035 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:46.848877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:46.858196 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:46.860274 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:46.861766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c566304d-4ec8-4f8d-9488-c9ca769041e3 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.181030 Jun 16 12:02:46.870876 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 466/896] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:46 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:47.880220 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:47.881455 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:47.895131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:47.895577 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:47.896501 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:47.897137 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:48.091619 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:48.100281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:48.101766 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:48.102916 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-63a0dd02-f06d-4e11-91a9-46b2e571ba3b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.227061 Jun 16 12:02:48.103462 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 431/897] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:47 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:49.121551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:49.122146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:49.128740 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:49.129183 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:49.130001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:49.130433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:49.275070 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:49.284608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:49.286170 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:49.287292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6d0d3640-fbef-43e8-974f-b122226ab361 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.170291 Jun 16 12:02:49.288126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 467/898] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:49 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:50.306470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:50.307067 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:50.314272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:50.315074 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:50.316083 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:50.316701 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:50.464640 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:50.473693 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:50.475317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:50.476507 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-eff7142d-72fc-49f5-b16f-0ffb6354f05a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.174227 Jun 16 12:02:50.477056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 432/899] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:50 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:51.494615 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:51.495256 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:51.502536 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:51.506056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:51.506056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:51.506056 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:51.660954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:51.670327 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:51.672342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:51.673291 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f5d08754-1b8d-49c1-a9ee-0da1dbdeffe9 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.182728 Jun 16 12:02:51.679467 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 468/900] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:51 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:52.694983 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:52.696178 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:52.703213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:52.703652 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:52.704640 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:52.705070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:52.861612 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:52.871388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:52.872997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:52.878048 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7029fad9-b373-4193-88cf-d56fbc7adb3a tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.189366 Jun 16 12:02:52.884050 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 433/901] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:52 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:53.896441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:53.898129 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:53.906062 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:53.906516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:53.907352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:53.908215 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:54.048875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:54.058594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:54.062441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:54.065323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-644e393e-4c37-4b28-9000-824ed2a6ea90 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.172514 Jun 16 12:02:54.065897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 469/902] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:53 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:55.084468 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:55.085092 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:55.092177 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:55.092620 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:55.093379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:55.093811 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:55.222549 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:55.226015 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:55.230829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:55.232425 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:55.233573 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a9d066e3-ec70-4cab-8e25-aaaeb803e3f8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.153009 Jun 16 12:02:55.234132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 434/903] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:55 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:56.251763 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:56.252415 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:56.258812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:56.260521 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:56.260521 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:56.260521 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:56.391516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:56.399571 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:56.401087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:56.402736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b1c6ad1e-5473-411f-b32b-79d37a6663db tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.154934 Jun 16 12:02:56.403332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 470/904] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:56 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:56.873683 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-768ba3b8-b89c-4841-bafa-04319e47c069 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:56.875215 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-768ba3b8-b89c-4841-bafa-04319e47c069 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:56.884423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-768ba3b8-b89c-4841-bafa-04319e47c069 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:56.884423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-768ba3b8-b89c-4841-bafa-04319e47c069 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:56.884423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-768ba3b8-b89c-4841-bafa-04319e47c069 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:56.884423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-768ba3b8-b89c-4841-bafa-04319e47c069 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:56.916841 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-768ba3b8-b89c-4841-bafa-04319e47c069 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047090 Jun 16 12:02:56.917428 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 435/905] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:02:56 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:02:57.061965 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-af234580-8074-47a9-811c-0cf753808b09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:57.062475 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-af234580-8074-47a9-811c-0cf753808b09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:57.068506 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af234580-8074-47a9-811c-0cf753808b09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:57.068951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af234580-8074-47a9-811c-0cf753808b09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:57.069702 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af234580-8074-47a9-811c-0cf753808b09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:57.070128 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-af234580-8074-47a9-811c-0cf753808b09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:57.098860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-af234580-8074-47a9-811c-0cf753808b09 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/e8436fdf-ce94-43ae-bac1-b579c30c2dcf" status: 200 len: 194 microversion: 2.1 time: 0.041276 Jun 16 12:02:57.099446 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 471/906] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jun 16 12:02:57 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/e8436fdf-ce94-43ae-bac1-b579c30c2dcf => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:02:57.109566 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3f0aba84-b8c1-40c6-a7d8-5df29f4b5aa8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:57.110055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3f0aba84-b8c1-40c6-a7d8-5df29f4b5aa8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:57.116904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3f0aba84-b8c1-40c6-a7d8-5df29f4b5aa8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:57.117378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3f0aba84-b8c1-40c6-a7d8-5df29f4b5aa8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:57.125230 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3f0aba84-b8c1-40c6-a7d8-5df29f4b5aa8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:57.125230 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3f0aba84-b8c1-40c6-a7d8-5df29f4b5aa8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:57.199918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-3f0aba84-b8c1-40c6-a7d8-5df29f4b5aa8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lazy-loading 'services' on Instance uuid 44d2914d-7d2a-4623-b9c1-3b0752478f96 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:02:57.410252 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3f0aba84-b8c1-40c6-a7d8-5df29f4b5aa8 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/e8436fdf-ce94-43ae-bac1-b579c30c2dcf" status: 202 len: 0 microversion: 2.1 time: 0.304476 Jun 16 12:02:57.410766 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 436/907] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:02:57 2022] DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/e8436fdf-ce94-43ae-bac1-b579c30c2dcf => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:02:57.421180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:57.421783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:57.430533 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:57.431250 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:57.438788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:57.439641 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:57.576719 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:57.588322 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:57.589807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:57.590971 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1ac168ec-03cf-482b-ae7c-5007cae49491 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.174170 Jun 16 12:02:57.591689 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 472/908] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:57 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:58.610475 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:58.611172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:58.618484 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:58.618923 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:58.619782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:58.625167 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:58.754947 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:58.763779 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:58.765433 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:58.766584 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-971770c0-5992-4687-a5cc-0d3825d797a1 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.160668 Jun 16 12:02:58.767139 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 437/909] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:58 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:02:59.327889 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-1b68c650-1eeb-46ad-9938-5e752d4df44f req-0f710156-630c-410e-b1fd-b39888147166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92dcff2-3f99-42cc-ba24-52bc94d88986", "name": "network-vif-plugged", "status": "completed", "tag": "7a3bc920-a057-45f1-b3ee-bc1f2c74986b"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:02:59.336266 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-1b68c650-1eeb-46ad-9938-5e752d4df44f req-0f710156-630c-410e-b1fd-b39888147166 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:59.336706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-1b68c650-1eeb-46ad-9938-5e752d4df44f req-0f710156-630c-410e-b1fd-b39888147166 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:59.348289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-1b68c650-1eeb-46ad-9938-5e752d4df44f req-0f710156-630c-410e-b1fd-b39888147166 service nova] Creating event network-vif-plugged:7a3bc920-a057-45f1-b3ee-bc1f2c74986b for instance f92dcff2-3f99-42cc-ba24-52bc94d88986 on hv-cinder-84614 Jun 16 12:02:59.353180 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-1b68c650-1eeb-46ad-9938-5e752d4df44f req-0f710156-630c-410e-b1fd-b39888147166 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029053 Jun 16 12:02:59.353745 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 473/910] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:02:59.580275 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-56735d9f-5868-478d-afb2-d8ade6547147 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:59.580760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-56735d9f-5868-478d-afb2-d8ade6547147 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:59.586717 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-56735d9f-5868-478d-afb2-d8ade6547147 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:59.587161 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-56735d9f-5868-478d-afb2-d8ade6547147 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:59.587925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-56735d9f-5868-478d-afb2-d8ade6547147 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:59.588352 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-56735d9f-5868-478d-afb2-d8ade6547147 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:59.620100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-56735d9f-5868-478d-afb2-d8ade6547147 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/cd162583-27dd-419e-bc64-5a7c86324e30" status: 200 len: 194 microversion: 2.1 time: 0.043698 Jun 16 12:02:59.620800 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 438/911] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jun 16 12:02:59 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/cd162583-27dd-419e-bc64-5a7c86324e30 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:02:59.631084 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3d11aa17-68c9-45d1-80f9-c786378ee3b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:59.636462 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3d11aa17-68c9-45d1-80f9-c786378ee3b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:59.638840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d11aa17-68c9-45d1-80f9-c786378ee3b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:59.639289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d11aa17-68c9-45d1-80f9-c786378ee3b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:59.640096 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d11aa17-68c9-45d1-80f9-c786378ee3b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:59.640534 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d11aa17-68c9-45d1-80f9-c786378ee3b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:59.733867 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-3d11aa17-68c9-45d1-80f9-c786378ee3b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lazy-loading 'services' on Instance uuid 44d2914d-7d2a-4623-b9c1-3b0752478f96 {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:02:59.785205 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:02:59.785853 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:02:59.792065 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:59.796911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:59.796911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:02:59.796911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:02:59.926142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:59.934434 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:59.940219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:02:59.940219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-da43dc4c-d42e-4e89-b069-2bb09b00d39d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.155823 Jun 16 12:02:59.940219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 439/912] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:02:59 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:02:59.942774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3d11aa17-68c9-45d1-80f9-c786378ee3b7 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/cd162583-27dd-419e-bc64-5a7c86324e30" status: 202 len: 0 microversion: 2.1 time: 0.315635 Jun 16 12:02:59.947552 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 474/913] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:02:59 2022] DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments/cd162583-27dd-419e-bc64-5a7c86324e30 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:03:00.957110 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:00.957736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:00.965085 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:00.965520 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:00.966302 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:00.966747 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:01.125239 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:01.133464 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:01.134977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:01.136713 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8301d3e6-e1d9-4204-9206-d903cbcbea55 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.184609 Jun 16 12:03:01.137283 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 440/914] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:00 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:03:02.155577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:02.156371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:02.164370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.164805 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.166693 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.167633 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.206603 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-891cbc4a-7167-41d4-b37e-75546d373f5e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:02.207646 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-891cbc4a-7167-41d4-b37e-75546d373f5e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:02.214913 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-891cbc4a-7167-41d4-b37e-75546d373f5e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.215481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-891cbc4a-7167-41d4-b37e-75546d373f5e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.216468 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-891cbc4a-7167-41d4-b37e-75546d373f5e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.216982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-891cbc4a-7167-41d4-b37e-75546d373f5e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.246904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-891cbc4a-7167-41d4-b37e-75546d373f5e tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044095 Jun 16 12:03:02.247551 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 441/915] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:03:02 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 12:03:02.320088 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:02.328677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:02.330337 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:02.331487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cadbc46c-7dd0-4bfe-87f2-16961c95fdc4 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1730 microversion: 2.20 time: 0.180757 Jun 16 12:03:02.332060 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 475/916] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:02 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:03:02.363355 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1072e3ea-111e-4cb2-a13f-e2186d5dede1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:02.364399 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1072e3ea-111e-4cb2-a13f-e2186d5dede1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:02.371002 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1072e3ea-111e-4cb2-a13f-e2186d5dede1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.371443 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1072e3ea-111e-4cb2-a13f-e2186d5dede1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.372223 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1072e3ea-111e-4cb2-a13f-e2186d5dede1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.372646 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1072e3ea-111e-4cb2-a13f-e2186d5dede1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.403208 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1072e3ea-111e-4cb2-a13f-e2186d5dede1 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044001 Jun 16 12:03:02.403753 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 442/917] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:03:02 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:03:02.461382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f81a80ab-702d-451f-b507-d522f729e2e9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:02.461871 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f81a80ab-702d-451f-b507-d522f729e2e9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:02.468232 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f81a80ab-702d-451f-b507-d522f729e2e9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.468675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f81a80ab-702d-451f-b507-d522f729e2e9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.469429 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f81a80ab-702d-451f-b507-d522f729e2e9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.469858 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f81a80ab-702d-451f-b507-d522f729e2e9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.494193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f81a80ab-702d-451f-b507-d522f729e2e9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:03:02.527417 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:02.794411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f81a80ab-702d-451f-b507-d522f729e2e9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 204 len: 0 microversion: 2.1 time: 0.336477 Jun 16 12:03:02.795040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 476/918] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:03:02 2022] DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:03:02.803241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2c6cc4c7-875e-41d7-8491-ba9d424c1772 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:02.803939 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2c6cc4c7-875e-41d7-8491-ba9d424c1772 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:02.810387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2c6cc4c7-875e-41d7-8491-ba9d424c1772 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.810831 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2c6cc4c7-875e-41d7-8491-ba9d424c1772 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.811592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2c6cc4c7-875e-41d7-8491-ba9d424c1772 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:02.812058 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2c6cc4c7-875e-41d7-8491-ba9d424c1772 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:02.943003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2c6cc4c7-875e-41d7-8491-ba9d424c1772 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:02.951085 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2c6cc4c7-875e-41d7-8491-ba9d424c1772 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1675 microversion: 2.1 time: 0.151856 Jun 16 12:03:02.951681 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 443/919] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:02 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:03.351373 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:03.352091 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:03.359580 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:03.360057 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:03.360819 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:03.361254 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:03.495926 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:03.503983 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:03.505513 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:03.506711 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bd0bb2ae-9ab2-4331-b23d-372e45459b8b tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1717 microversion: 2.20 time: 0.159900 Jun 16 12:03:03.507270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 477/920] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:03 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:03:03.969279 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a3fced6f-d721-4e15-b17f-ec84114c25b3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:03.969923 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a3fced6f-d721-4e15-b17f-ec84114c25b3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:03.971847 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=44 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:03.976925 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a3fced6f-d721-4e15-b17f-ec84114c25b3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:03.977375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a3fced6f-d721-4e15-b17f-ec84114c25b3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:03.978137 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a3fced6f-d721-4e15-b17f-ec84114c25b3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:03.978571 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a3fced6f-d721-4e15-b17f-ec84114c25b3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:04.106264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a3fced6f-d721-4e15-b17f-ec84114c25b3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:04.113721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a3fced6f-d721-4e15-b17f-ec84114c25b3 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1675 microversion: 2.1 time: 0.148662 Jun 16 12:03:04.114287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 444/921] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:03 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:05.131079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c68f3a50-846f-4497-87f5-cfd2074011cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:05.131683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c68f3a50-846f-4497-87f5-cfd2074011cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:05.138781 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c68f3a50-846f-4497-87f5-cfd2074011cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:05.139222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c68f3a50-846f-4497-87f5-cfd2074011cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:05.140186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c68f3a50-846f-4497-87f5-cfd2074011cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:05.140621 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c68f3a50-846f-4497-87f5-cfd2074011cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:05.286085 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c68f3a50-846f-4497-87f5-cfd2074011cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:05.297283 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c68f3a50-846f-4497-87f5-cfd2074011cd tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1675 microversion: 2.1 time: 0.169971 Jun 16 12:03:05.306692 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 478/922] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:05 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:05.586118 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-0cddaa9d-e385-480a-85b7-8f13b31e01bd req-98fdc98d-46b0-4c7f-8f22-ac51f1fe9eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d2914d-7d2a-4623-b9c1-3b0752478f96", "name": "network-vif-deleted", "tag": "0a6d60f9-c7ff-43a6-8e1e-5247b2c29563"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:03:05.595226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-0cddaa9d-e385-480a-85b7-8f13b31e01bd req-98fdc98d-46b0-4c7f-8f22-ac51f1fe9eb3 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:05.595584 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-0cddaa9d-e385-480a-85b7-8f13b31e01bd req-98fdc98d-46b0-4c7f-8f22-ac51f1fe9eb3 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:05.606973 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-0cddaa9d-e385-480a-85b7-8f13b31e01bd req-98fdc98d-46b0-4c7f-8f22-ac51f1fe9eb3 service nova] Creating event network-vif-deleted:0a6d60f9-c7ff-43a6-8e1e-5247b2c29563 for instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 on hv-cinder-84614 Jun 16 12:03:05.612032 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-0cddaa9d-e385-480a-85b7-8f13b31e01bd req-98fdc98d-46b0-4c7f-8f22-ac51f1fe9eb3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029588 Jun 16 12:03:05.612785 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 445/923] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:03:06.315950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:06.316555 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:06.322764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:06.323839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:06.324625 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:06.325051 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:06.357608 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:06.358058 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:06.358498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lazy-loading 'fault' on Instance uuid 44d2914d-7d2a-4623-b9c1-3b0752478f96 {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:03:06.404979 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d8c04611e24dffad16f8bb97e111f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918001434f5c4d76a3ab9c46616eec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:06.416757 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e36a2620-d83e-4b5c-984b-04e69747cb59 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 200 len: 1328 microversion: 2.1 time: 0.104506 Jun 16 12:03:06.418430 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 479/924] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:06 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:07.437928 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:07.438610 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:07.444692 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:07.445132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:07.445876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:07.446300 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:07.459950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] HTTP exception thrown: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Request method failure captured: Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 HTTP/1.1 Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpc9C6OjINLkNYB-_C7T23VVwj_fAT660uiISCslXmp-_9qG3MlmzQNZ-0EXwXaDcVjLlpfTQdgw1VC5krSG8_qM_7OoSGADKwHjm9mzw4fvQfX3w4KXcy6Jup8k7OWfx-lkKTqEd_PkrRTFBI0-utcj1tKdobYkYEae3e-JZtk1Qc Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:03:07.461530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 13d8c04611e24dffad16f8bb97e111f2 Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:07.463280 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '44d2914d-7d2a-4623-b9c1-3b0752478f96'} Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:07.464527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:07.466260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:07.467887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Returning 404 to user: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:07.467887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ff87a250-fa06-4fff-a8d6-a71730f2a518 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 404 len: 111 microversion: 2.1 time: 0.030217 Jun 16 12:03:07.467887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 446/925] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:07 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:03:07.473459 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-719a25ff-026e-4219-b76c-4d8f73e2a3b6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '.version_select at 0x7f43344a0160>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:07.532118 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-719a25ff-026e-4219-b76c-4d8f73e2a3b6 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1305258255" status: 202 len: 0 microversion: 2.1 time: 0.062714 Jun 16 12:03:07.532700 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 480/926] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 12:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1305258255 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:03:10.931697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:10.933405 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:10.939887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:10.940287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:10.941035 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:10.941466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:10.954679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] HTTP exception thrown: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Request method failure captured: Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 HTTP/1.1 Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpc9C6OjINLkNYB-_C7T23VVwj_fAT660uiISCslXmp-_9qG3MlmzQNZ-0EXwXaDcVjLlpfTQdgw1VC5krSG8_qM_7OoSGADKwHjm9mzw4fvQfX3w4KXcy6Jup8k7OWfx-lkKTqEd_PkrRTFBI0-utcj1tKdobYkYEae3e-JZtk1Qc Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:03:10.956212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 13d8c04611e24dffad16f8bb97e111f2 Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.958006 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '44d2914d-7d2a-4623-b9c1-3b0752478f96'} Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:10.958953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.961559 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.963056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Returning 404 to user: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:10.963056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-988be3be-6cf2-4245-b1b1-ce955e7bf1aa tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 404 len: 111 microversion: 2.1 time: 0.029752 Jun 16 12:03:10.963056 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 447/927] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:03:10 2022] DELETE /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:03:10.966749 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:10.967362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: 44d2914d-7d2a-4623-b9c1-3b0752478f96] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:10.973780 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:10.974249 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:10.975017 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:10.975455 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:10.989550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] HTTP exception thrown: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Request method failure captured: Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 HTTP/1.1 Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpc9C6OjINLkNYB-_C7T23VVwj_fAT660uiISCslXmp-_9qG3MlmzQNZ-0EXwXaDcVjLlpfTQdgw1VC5krSG8_qM_7OoSGADKwHjm9mzw4fvQfX3w4KXcy6Jup8k7OWfx-lkKTqEd_PkrRTFBI0-utcj1tKdobYkYEae3e-JZtk1Qc Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:03:10.991221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 13d8c04611e24dffad16f8bb97e111f2 Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.992799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '44d2914d-7d2a-4623-b9c1-3b0752478f96'} Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:10.993807 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. Jun 16 12:03:10.995835 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:10.997307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Returning 404 to user: Instance 44d2914d-7d2a-4623-b9c1-3b0752478f96 could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:10.997307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4c019510-2987-44f1-90db-6c8ebdcbd2b9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96" status: 404 len: 111 microversion: 2.1 time: 0.030332 Jun 16 12:03:10.997307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 481/928] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:10 2022] GET /compute/v2.1/servers/44d2914d-7d2a-4623-b9c1-3b0752478f96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:03:12.224347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:12.224829 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:12.231239 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:12.231621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:12.232423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:12.232856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:12.246395 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] HTTP exception thrown: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Request method failure captured: Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: DELETE /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 HTTP/1.1 Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpc9C6OjINLkNYB-_C7T23VVwj_fAT660uiISCslXmp-_9qG3MlmzQNZ-0EXwXaDcVjLlpfTQdgw1VC5krSG8_qM_7OoSGADKwHjm9mzw4fvQfX3w4KXcy6Jup8k7OWfx-lkKTqEd_PkrRTFBI0-utcj1tKdobYkYEae3e-JZtk1Qc Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:03:12.247936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 13d8c04611e24dffad16f8bb97e111f2 Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.249665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': 'bd786b9e-48e7-4695-8549-aeabb6511e72'} Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:12.250565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.252061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.253540 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Returning 404 to user: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:12.253540 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-47a766fe-4241-405b-abaf-2e2fea5794a9 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 404 len: 111 microversion: 2.1 time: 0.029084 Jun 16 12:03:12.253540 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 448/929] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:03:12 2022] DELETE /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:03:12.257741 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:12.258352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] [instance: bd786b9e-48e7-4695-8549-aeabb6511e72] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:12.265467 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:12.265937 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:12.266696 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:12.267131 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:12.280249 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] HTTP exception thrown: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Request method failure captured: Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 HTTP/1.1 Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpc9C6OjINLkNYB-_C7T23VVwj_fAT660uiISCslXmp-_9qG3MlmzQNZ-0EXwXaDcVjLlpfTQdgw1VC5krSG8_qM_7OoSGADKwHjm9mzw4fvQfX3w4KXcy6Jup8k7OWfx-lkKTqEd_PkrRTFBI0-utcj1tKdobYkYEae3e-JZtk1Qc Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:03:12.281755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/918001434f5c4d76a3ab9c46616eec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 918001434f5c4d76a3ab9c46616eec67 Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeTestJSON-664061479 Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 13d8c04611e24dffad16f8bb97e111f2 Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeTestJSON-664061479-project Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.283334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'bd786b9e-48e7-4695-8549-aeabb6511e72'} Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:12.284280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. Jun 16 12:03:12.285768 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:12.287094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] Returning 404 to user: Instance bd786b9e-48e7-4695-8549-aeabb6511e72 could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:12.287094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ca5b35d6-1a33-4df8-b0c1-7e6d2f8e1357 tempest-AttachVolumeTestJSON-664061479 tempest-AttachVolumeTestJSON-664061479-project] 10.222.0.40 "GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72" status: 404 len: 111 microversion: 2.1 time: 0.029209 Jun 16 12:03:12.287094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 482/930] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:12 2022] GET /compute/v2.1/servers/bd786b9e-48e7-4695-8549-aeabb6511e72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:03:32.959211 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3dbfeaea-8356-4c7c-848a-80351fa2edab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:32.960158 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3dbfeaea-8356-4c7c-848a-80351fa2edab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:32.962850 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=9 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:32.964490 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:32.968753 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3dbfeaea-8356-4c7c-848a-80351fa2edab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:32.969187 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3dbfeaea-8356-4c7c-848a-80351fa2edab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:32.969948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3dbfeaea-8356-4c7c-848a-80351fa2edab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:32.970407 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3dbfeaea-8356-4c7c-848a-80351fa2edab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:33.000467 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3dbfeaea-8356-4c7c-848a-80351fa2edab tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045250 Jun 16 12:03:33.001025 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 449/931] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jun 16 12:03:32 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:33.060949 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ad18faa0-ba34-467a-89b3-343ff106059d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:33.061541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ad18faa0-ba34-467a-89b3-343ff106059d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:33.063795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:33.064456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:33.070105 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad18faa0-ba34-467a-89b3-343ff106059d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:33.070547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad18faa0-ba34-467a-89b3-343ff106059d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:33.076043 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad18faa0-ba34-467a-89b3-343ff106059d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:33.076043 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad18faa0-ba34-467a-89b3-343ff106059d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:33.106209 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ad18faa0-ba34-467a-89b3-343ff106059d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:03:33.433925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ad18faa0-ba34-467a-89b3-343ff106059d tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 204 len: 0 microversion: 2.20 time: 0.377128 Jun 16 12:03:33.434590 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 483/932] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jun 16 12:03:33 2022] DELETE /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 12:03:33.442976 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:33.443583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:33.450974 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:33.451417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:33.452216 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:33.452654 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:33.587367 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:33.596130 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:33.597630 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:33.599213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c0640564-d3ce-4e4e-a9ee-afcf689d0523 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.160333 Jun 16 12:03:33.599605 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 450/933] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:33 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:03:34.618587 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:34.619286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:34.626485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:34.626931 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:34.627699 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:34.628163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:34.759245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:34.769061 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:34.770617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:34.772126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4eb8fc85-5a80-4766-a69f-873d55a0b7fe tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1723 microversion: 2.20 time: 0.158197 Jun 16 12:03:34.772906 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 484/934] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:34 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:03:35.633923 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-98874f83-b732-429c-8429-392559061fa1 req-74a875ca-3859-48c7-8dbc-00380e194595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92dcff2-3f99-42cc-ba24-52bc94d88986", "name": "network-vif-deleted", "tag": "7a3bc920-a057-45f1-b3ee-bc1f2c74986b"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:03:35.642731 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-98874f83-b732-429c-8429-392559061fa1 req-74a875ca-3859-48c7-8dbc-00380e194595 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:35.643253 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-98874f83-b732-429c-8429-392559061fa1 req-74a875ca-3859-48c7-8dbc-00380e194595 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:35.655031 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-98874f83-b732-429c-8429-392559061fa1 req-74a875ca-3859-48c7-8dbc-00380e194595 service nova] Creating event network-vif-deleted:7a3bc920-a057-45f1-b3ee-bc1f2c74986b for instance f92dcff2-3f99-42cc-ba24-52bc94d88986 on hv-cinder-84614 Jun 16 12:03:35.660460 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-98874f83-b732-429c-8429-392559061fa1 req-74a875ca-3859-48c7-8dbc-00380e194595 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030489 Jun 16 12:03:35.661082 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 451/935] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:03:35.790621 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:35.791217 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:35.800827 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:35.801270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:35.802557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:35.802557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:35.914998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:35.924795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:35.927047 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97ce6d944eb74b9794d6d0d5f18d4bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659db25373614c8da6fc81e59ef9c6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:35.928851 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-8e06b4c8-7f6a-477a-b046-cd3797d977fb tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 200 len: 1366 microversion: 2.20 time: 0.141744 Jun 16 12:03:35.929999 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 485/936] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:35 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:03:36.947302 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:36.948658 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:36.954979 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:36.955711 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:36.956357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:36.957254 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:36.970302 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] HTTP exception thrown: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Request method failure captured: Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 HTTP/1.1 Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpedl4IEkehSq-0jGYd7TA-o3jsWNZrR022CMW_08cVOPb-eZoYkg1s8vhWNLZYOYtxbfknK4r7UbuZLU862LBz8ryUFDarBhDKGlP6dduyxLBUB2bbrQpjMiGP2EYYgftIbHCqaO1n6C1OyrjXRyR1s4nNShIuENAdHCRJBl6k7bc Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:03:36.971994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 97ce6d944eb74b9794d6d0d5f18d4bad Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:36.973949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': 'f92dcff2-3f99-42cc-ba24-52bc94d88986'} Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:36.974948 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:36.977023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:36.978587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Returning 404 to user: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:36.978587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-af4d4862-f440-4b30-a5e8-20daa139adc8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 404 len: 111 microversion: 2.20 time: 0.030985 Jun 16 12:03:36.978587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 452/937] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:36 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:03:36.983046 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9b644d28-a69c-4a3d-8cfb-3321a86fc1e8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '.version_select at 0x7f4334462ca0>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:37.074712 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9b644d28-a69c-4a3d-8cfb-3321a86fc1e8 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-829723833" status: 204 len: 0 microversion: 2.20 time: 0.095407 Jun 16 12:03:37.075289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 486/938] 10.222.0.40 () {60 vars in 1258 bytes} [Thu Jun 16 12:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-829723833 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 12:03:39.030136 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:39.030620 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:39.036950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:39.037386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:39.038135 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:39.038558 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:39.052449 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] HTTP exception thrown: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Request method failure captured: Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: DELETE /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 HTTP/1.1 Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpedl4IEkehSq-0jGYd7TA-o3jsWNZrR022CMW_08cVOPb-eZoYkg1s8vhWNLZYOYtxbfknK4r7UbuZLU862LBz8ryUFDarBhDKGlP6dduyxLBUB2bbrQpjMiGP2EYYgftIbHCqaO1n6C1OyrjXRyR1s4nNShIuENAdHCRJBl6k7bc Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:03:39.053954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 97ce6d944eb74b9794d6d0d5f18d4bad Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.055528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': 'f92dcff2-3f99-42cc-ba24-52bc94d88986'} Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:39.056598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.058157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.059743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Returning 404 to user: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:39.059743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-83a6fd66-bf84-4630-8eea-080979d2c269 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 404 len: 111 microversion: 2.20 time: 0.029474 Jun 16 12:03:39.059743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 453/939] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jun 16 12:03:39 2022] DELETE /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:03:39.064726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:39.065373 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: f92dcff2-3f99-42cc-ba24-52bc94d88986] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:39.072340 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:39.072813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:39.073573 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:39.074008 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:39.089359 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] HTTP exception thrown: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Request method failure captured: Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 HTTP/1.1 Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpedl4IEkehSq-0jGYd7TA-o3jsWNZrR022CMW_08cVOPb-eZoYkg1s8vhWNLZYOYtxbfknK4r7UbuZLU862LBz8ryUFDarBhDKGlP6dduyxLBUB2bbrQpjMiGP2EYYgftIbHCqaO1n6C1OyrjXRyR1s4nNShIuENAdHCRJBl6k7bc Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:03:39.090984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 97ce6d944eb74b9794d6d0d5f18d4bad Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.094211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'f92dcff2-3f99-42cc-ba24-52bc94d88986'} Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:39.095101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. Jun 16 12:03:39.096551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:39.098125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Returning 404 to user: Instance f92dcff2-3f99-42cc-ba24-52bc94d88986 could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:39.098125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a439a3d6-0eca-49ce-8341-96cbe993d323 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986" status: 404 len: 111 microversion: 2.20 time: 0.032117 Jun 16 12:03:39.098125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 487/940] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:39 2022] GET /compute/v2.1/servers/f92dcff2-3f99-42cc-ba24-52bc94d88986 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:03:40.312558 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:40.313053 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:40.319347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:40.319782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:40.320565 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:40.320990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:40.336864 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] HTTP exception thrown: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Request method failure captured: Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: DELETE /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a HTTP/1.1 Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxpedl4IEkehSq-0jGYd7TA-o3jsWNZrR022CMW_08cVOPb-eZoYkg1s8vhWNLZYOYtxbfknK4r7UbuZLU862LBz8ryUFDarBhDKGlP6dduyxLBUB2bbrQpjMiGP2EYYgftIbHCqaO1n6C1OyrjXRyR1s4nNShIuENAdHCRJBl6k7bc Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:03:40.338430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 97ce6d944eb74b9794d6d0d5f18d4bad Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.340679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '6646f09a-70e9-487b-98f0-89ab1fe5508a'} Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:40.344474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.347055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.349625 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Returning 404 to user: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:40.349625 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-54852afc-895d-4d5e-87ce-761d12507e88 tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 404 len: 111 microversion: 2.20 time: 0.031240 Jun 16 12:03:40.349625 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 454/941] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jun 16 12:03:40 2022] DELETE /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:03:40.350055 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:40.350534 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] [instance: 6646f09a-70e9-487b-98f0-89ab1fe5508a] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:40.357435 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:40.358749 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:40.358749 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:40.359078 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:40.373547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] HTTP exception thrown: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Request method failure captured: Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a HTTP/1.1 Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxpedl4IEkehSq-0jGYd7TA-o3jsWNZrR022CMW_08cVOPb-eZoYkg1s8vhWNLZYOYtxbfknK4r7UbuZLU862LBz8ryUFDarBhDKGlP6dduyxLBUB2bbrQpjMiGP2EYYgftIbHCqaO1n6C1OyrjXRyR1s4nNShIuENAdHCRJBl6k7bc Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:03:40.375154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/659db25373614c8da6fc81e59ef9c6f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 659db25373614c8da6fc81e59ef9c6f6 Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-642847952 Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 97ce6d944eb74b9794d6d0d5f18d4bad Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeShelveTestJSON-642847952-project Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.376791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '6646f09a-70e9-487b-98f0-89ab1fe5508a'} Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:03:40.377646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. Jun 16 12:03:40.379271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:03:40.382519 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] Returning 404 to user: Instance 6646f09a-70e9-487b-98f0-89ab1fe5508a could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:03:40.382519 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1c279dad-f48f-4561-9ce7-492b906e87ba tempest-AttachVolumeShelveTestJSON-642847952 tempest-AttachVolumeShelveTestJSON-642847952-project] 10.222.0.40 "GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a" status: 404 len: 111 microversion: 2.20 time: 0.030972 Jun 16 12:03:40.382519 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 488/942] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 12:03:40 2022] GET /compute/v2.1/servers/6646f09a-70e9-487b-98f0-89ab1fe5508a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:03:49.610659 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d720fa34-8720-4e9a-bf58-4e66679185d2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:03:49.610659 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d720fa34-8720-4e9a-bf58-4e66679185d2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:49.618099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d720fa34-8720-4e9a-bf58-4e66679185d2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:49.618667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d720fa34-8720-4e9a-bf58-4e66679185d2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:49.619542 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d720fa34-8720-4e9a-bf58-4e66679185d2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:49.620234 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d720fa34-8720-4e9a-bf58-4e66679185d2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:49.647306 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-d720fa34-8720-4e9a-bf58-4e66679185d2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lazy-loading 'flavor' on Instance uuid b481fc54-9d0a-4ce3-a4f8-651a22d1d276 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:03:49.958329 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d720fa34-8720-4e9a-bf58-4e66679185d2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "POST /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276/action" status: 202 len: 0 microversion: 2.1 time: 0.352981 Jun 16 12:03:49.958929 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 455/943] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 12:03:49 2022] POST /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:03:49.968576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-053de08b-b044-4dc5-aff0-dfaa913cc0a7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:49.969179 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-053de08b-b044-4dc5-aff0-dfaa913cc0a7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:49.975706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-053de08b-b044-4dc5-aff0-dfaa913cc0a7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:49.976350 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-053de08b-b044-4dc5-aff0-dfaa913cc0a7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:49.977113 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-053de08b-b044-4dc5-aff0-dfaa913cc0a7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:49.977543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-053de08b-b044-4dc5-aff0-dfaa913cc0a7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:50.264040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-053de08b-b044-4dc5-aff0-dfaa913cc0a7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:50.272513 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-053de08b-b044-4dc5-aff0-dfaa913cc0a7 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.309145 Jun 16 12:03:50.273088 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 489/944] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:49 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:51.290955 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f5b8d7f9-250f-4a36-8b0a-b6a6efc3fe55 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:51.292492 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f5b8d7f9-250f-4a36-8b0a-b6a6efc3fe55 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:51.299901 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f5b8d7f9-250f-4a36-8b0a-b6a6efc3fe55 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:51.300583 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f5b8d7f9-250f-4a36-8b0a-b6a6efc3fe55 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:51.301569 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f5b8d7f9-250f-4a36-8b0a-b6a6efc3fe55 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:51.302161 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f5b8d7f9-250f-4a36-8b0a-b6a6efc3fe55 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:51.429836 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7d89f569-c2fb-4e0e-b69d-fc896e76104c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: .version_select at 0x7f433478b5e0>, body: {"keypair": {"name": "tempest-keypair-1195160341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHNW1p6Dtqcag5sE1rTN0y5m4d2nHmDkpMaVZNHK6chKicwz7uWfqHae+vACgZqN0UHxnJKbc3Hxp6Q1ivhQjJZqKul3cV+8rd7gT3AlyAghTV4BFnBUskBYpxZ+QH8fg=="}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:03:51.451578 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-7d89f569-c2fb-4e0e-b69d-fc896e76104c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:03:51.457226 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-7d89f569-c2fb-4e0e-b69d-fc896e76104c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for user 61dcabaa88464ba2aee72c163414d327 and project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:03:51.461287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f5b8d7f9-250f-4a36-8b0a-b6a6efc3fe55 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:51.471077 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f5b8d7f9-250f-4a36-8b0a-b6a6efc3fe55 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.185184 Jun 16 12:03:51.473383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 456/945] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:51 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:51.624336 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7d89f569-c2fb-4e0e-b69d-fc896e76104c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338333 Jun 16 12:03:51.625399 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 490/946] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 12:03:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:03:52.495776 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5f9593e5-8784-4b2b-96ae-c7f242348f2f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:52.497582 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5f9593e5-8784-4b2b-96ae-c7f242348f2f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:52.504626 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f9593e5-8784-4b2b-96ae-c7f242348f2f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:52.505348 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f9593e5-8784-4b2b-96ae-c7f242348f2f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:52.506244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f9593e5-8784-4b2b-96ae-c7f242348f2f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:52.506760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5f9593e5-8784-4b2b-96ae-c7f242348f2f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:52.777403 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5f9593e5-8784-4b2b-96ae-c7f242348f2f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:52.788295 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5f9593e5-8784-4b2b-96ae-c7f242348f2f tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.296920 Jun 16 12:03:52.788887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 457/947] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:52 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:53.809964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c4a6917d-15d2-42f0-96b7-3057eb07ff22 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:53.812650 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c4a6917d-15d2-42f0-96b7-3057eb07ff22 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:53.820784 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4a6917d-15d2-42f0-96b7-3057eb07ff22 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:53.822451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4a6917d-15d2-42f0-96b7-3057eb07ff22 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:53.822451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4a6917d-15d2-42f0-96b7-3057eb07ff22 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:53.822963 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c4a6917d-15d2-42f0-96b7-3057eb07ff22 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:54.077200 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c4a6917d-15d2-42f0-96b7-3057eb07ff22 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:54.085623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c4a6917d-15d2-42f0-96b7-3057eb07ff22 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.283028 Jun 16 12:03:54.096042 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 491/948] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:53 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:54.579212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1336158358", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5da113f2-855d-427a-92da-a197315b7e34"}], "security_groups": [{"name": "tempest-securitygroup--293081379"}], "key_name": "tempest-keypair-1195160341", "user_data": "}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:03:54.691888 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] validate_networks() for [('5da113f2-855d-427a-92da-a197315b7e34', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:03:55.105029 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6512c9e0-385d-4890-ab3f-515337b40d7d tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:55.105767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6512c9e0-385d-4890-ab3f-515337b40d7d tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:55.112674 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6512c9e0-385d-4890-ab3f-515337b40d7d tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:55.113109 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6512c9e0-385d-4890-ab3f-515337b40d7d tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:55.113873 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6512c9e0-385d-4890-ab3f-515337b40d7d tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:55.114307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6512c9e0-385d-4890-ab3f-515337b40d7d tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:55.114816 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:03:55.115248 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:03:55.115722 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:03:55.116198 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:03:55.116875 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:03:55.125782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:55.126208 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:55.133141 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:55.133141 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:55.145857 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:03:55.150379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for user 61dcabaa88464ba2aee72c163414d327 and project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:03:55.172571 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:03:55.174902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:03:55.248881 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6512c9e0-385d-4890-ab3f-515337b40d7d tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:55.256288 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6512c9e0-385d-4890-ab3f-515337b40d7d tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.155103 Jun 16 12:03:55.256921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 492/949] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:55 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:55.327590 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b52875ac-ca0b-4985-a283-ed10dee0a254 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.752592 Jun 16 12:03:55.328477 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 458/950] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:03:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:03:55.338021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-64cc496b-2c0b-46b3-b5d8-7ca3f0b0a262 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:55.338628 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-64cc496b-2c0b-46b3-b5d8-7ca3f0b0a262 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:55.395978 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-64cc496b-2c0b-46b3-b5d8-7ca3f0b0a262 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:55.403043 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-64cc496b-2c0b-46b3-b5d8-7ca3f0b0a262 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1242 microversion: 2.1 time: 0.068508 Jun 16 12:03:55.412510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 493/951] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:55 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:56.273671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3481d4ca-fd25-4cc6-a8a8-9ca36c7d6939 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:56.274277 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3481d4ca-fd25-4cc6-a8a8-9ca36c7d6939 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:56.284693 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3481d4ca-fd25-4cc6-a8a8-9ca36c7d6939 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:56.285131 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3481d4ca-fd25-4cc6-a8a8-9ca36c7d6939 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:56.285891 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3481d4ca-fd25-4cc6-a8a8-9ca36c7d6939 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:56.286320 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3481d4ca-fd25-4cc6-a8a8-9ca36c7d6939 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:56.420255 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cb9e153d-4fe2-4694-af0b-313d56a33552 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:56.420867 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cb9e153d-4fe2-4694-af0b-313d56a33552 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:56.425066 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3481d4ca-fd25-4cc6-a8a8-9ca36c7d6939 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:56.428764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb9e153d-4fe2-4694-af0b-313d56a33552 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:56.429211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb9e153d-4fe2-4694-af0b-313d56a33552 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:56.430059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb9e153d-4fe2-4694-af0b-313d56a33552 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:56.430708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cb9e153d-4fe2-4694-af0b-313d56a33552 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:56.433771 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3481d4ca-fd25-4cc6-a8a8-9ca36c7d6939 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.163795 Jun 16 12:03:56.434738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 459/952] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:56 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:03:56.505270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cb9e153d-4fe2-4694-af0b-313d56a33552 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:56.505270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cb9e153d-4fe2-4694-af0b-313d56a33552 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1246 microversion: 2.1 time: 0.088604 Jun 16 12:03:56.505270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 494/953] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:56 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:57.457594 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-7f53a385-cffc-4760-81f3-7a2b714467eb tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:57.458207 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-7f53a385-cffc-4760-81f3-7a2b714467eb tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:57.466684 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7f53a385-cffc-4760-81f3-7a2b714467eb tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:57.467121 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7f53a385-cffc-4760-81f3-7a2b714467eb tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:57.467896 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7f53a385-cffc-4760-81f3-7a2b714467eb tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:57.468330 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-7f53a385-cffc-4760-81f3-7a2b714467eb tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:57.522518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fb1a427c-8351-4fca-91cb-55ed8794648f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:57.522930 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-fb1a427c-8351-4fca-91cb-55ed8794648f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:57.529782 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fb1a427c-8351-4fca-91cb-55ed8794648f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:57.530229 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fb1a427c-8351-4fca-91cb-55ed8794648f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:57.531011 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fb1a427c-8351-4fca-91cb-55ed8794648f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:57.531448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-fb1a427c-8351-4fca-91cb-55ed8794648f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:57.630165 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-fb1a427c-8351-4fca-91cb-55ed8794648f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:57.635733 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-fb1a427c-8351-4fca-91cb-55ed8794648f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1302 microversion: 2.1 time: 0.117429 Jun 16 12:03:57.636492 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 495/954] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:57 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1302 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:57.680341 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-7f53a385-cffc-4760-81f3-7a2b714467eb tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:57.694694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-7f53a385-cffc-4760-81f3-7a2b714467eb tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.242066 Jun 16 12:03:57.695379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 460/955] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:57 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:58.654386 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9b1e1693-643d-40d2-8b86-685155166014 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:58.654997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9b1e1693-643d-40d2-8b86-685155166014 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:58.661771 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9b1e1693-643d-40d2-8b86-685155166014 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:58.662436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9b1e1693-643d-40d2-8b86-685155166014 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:58.663211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9b1e1693-643d-40d2-8b86-685155166014 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:58.663643 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9b1e1693-643d-40d2-8b86-685155166014 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:58.711747 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b8fd8005-930f-437a-9a78-6aaf011ff94b tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:58.720082 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b8fd8005-930f-437a-9a78-6aaf011ff94b tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:58.727541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8fd8005-930f-437a-9a78-6aaf011ff94b tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:58.729662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8fd8005-930f-437a-9a78-6aaf011ff94b tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:58.729662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8fd8005-930f-437a-9a78-6aaf011ff94b tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:58.729662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b8fd8005-930f-437a-9a78-6aaf011ff94b tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:58.834593 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9b1e1693-643d-40d2-8b86-685155166014 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:58.844188 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9b1e1693-643d-40d2-8b86-685155166014 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.194035 Jun 16 12:03:58.844770 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 496/956] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:58 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:03:58.944423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b8fd8005-930f-437a-9a78-6aaf011ff94b tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:03:58.952901 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b8fd8005-930f-437a-9a78-6aaf011ff94b tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.245232 Jun 16 12:03:58.953688 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 461/957] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:58 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:03:59.342263 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-3f913d77-233b-4536-846f-f97944b338c6 req-4d9b57af-bee0-4851-8246-98efb804228a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4221add6-1a15-44e5-b48a-6a62e0a302ef", "tag": "167cae65-c8a1-4d89-8e20-2f8457a0736c"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:03:59.351082 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-3f913d77-233b-4536-846f-f97944b338c6 req-4d9b57af-bee0-4851-8246-98efb804228a service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:59.351986 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-3f913d77-233b-4536-846f-f97944b338c6 req-4d9b57af-bee0-4851-8246-98efb804228a service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:59.366138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-3f913d77-233b-4536-846f-f97944b338c6 req-4d9b57af-bee0-4851-8246-98efb804228a service nova] Creating event network-changed:167cae65-c8a1-4d89-8e20-2f8457a0736c for instance 4221add6-1a15-44e5-b48a-6a62e0a302ef on hv-cinder-84614 Jun 16 12:03:59.372035 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-3f913d77-233b-4536-846f-f97944b338c6 req-4d9b57af-bee0-4851-8246-98efb804228a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034137 Jun 16 12:03:59.373316 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 497/958] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:03:59.862169 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-08d047f4-99d6-4cfb-9969-3c1c4ccc2003 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:59.863378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-08d047f4-99d6-4cfb-9969-3c1c4ccc2003 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:59.870135 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-08d047f4-99d6-4cfb-9969-3c1c4ccc2003 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:59.870569 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-08d047f4-99d6-4cfb-9969-3c1c4ccc2003 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:59.872024 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-08d047f4-99d6-4cfb-9969-3c1c4ccc2003 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:59.872459 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-08d047f4-99d6-4cfb-9969-3c1c4ccc2003 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:59.971199 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7df00812-cf21-4ab4-a08e-c4b0d18b0fb6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:03:59.971899 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7df00812-cf21-4ab4-a08e-c4b0d18b0fb6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:03:59.979026 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7df00812-cf21-4ab4-a08e-c4b0d18b0fb6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:59.979462 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7df00812-cf21-4ab4-a08e-c4b0d18b0fb6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:03:59.980259 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7df00812-cf21-4ab4-a08e-c4b0d18b0fb6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:03:59.981239 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7df00812-cf21-4ab4-a08e-c4b0d18b0fb6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:00.084063 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-08d047f4-99d6-4cfb-9969-3c1c4ccc2003 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:00.092713 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-08d047f4-99d6-4cfb-9969-3c1c4ccc2003 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.234283 Jun 16 12:04:00.093288 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 462/959] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:59 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:00.116877 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7df00812-cf21-4ab4-a08e-c4b0d18b0fb6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:00.124622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7df00812-cf21-4ab4-a08e-c4b0d18b0fb6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.158178 Jun 16 12:04:00.125179 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 498/960] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:03:59 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:04:01.110836 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-32bd84a9-454f-4b87-9a38-fee3f1a3c0e3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:01.111437 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-32bd84a9-454f-4b87-9a38-fee3f1a3c0e3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:01.118160 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32bd84a9-454f-4b87-9a38-fee3f1a3c0e3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:01.118600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32bd84a9-454f-4b87-9a38-fee3f1a3c0e3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:01.119359 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32bd84a9-454f-4b87-9a38-fee3f1a3c0e3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:01.119785 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32bd84a9-454f-4b87-9a38-fee3f1a3c0e3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:01.143327 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-416f401f-eeba-4905-89d7-c03e3c9a85ba tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:01.145052 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-416f401f-eeba-4905-89d7-c03e3c9a85ba tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:01.154212 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-416f401f-eeba-4905-89d7-c03e3c9a85ba tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:01.154662 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-416f401f-eeba-4905-89d7-c03e3c9a85ba tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:01.155432 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-416f401f-eeba-4905-89d7-c03e3c9a85ba tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:01.156046 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-416f401f-eeba-4905-89d7-c03e3c9a85ba tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:01.293767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-416f401f-eeba-4905-89d7-c03e3c9a85ba tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:01.302381 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-416f401f-eeba-4905-89d7-c03e3c9a85ba tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.163687 Jun 16 12:04:01.302791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 499/961] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:01 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:04:01.314637 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-32bd84a9-454f-4b87-9a38-fee3f1a3c0e3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:01.322286 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-32bd84a9-454f-4b87-9a38-fee3f1a3c0e3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.215366 Jun 16 12:04:01.322978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 463/962] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:01 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:02.318907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ee7e8ceb-a102-4080-b604-b9b9e20dc20a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:02.319515 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ee7e8ceb-a102-4080-b604-b9b9e20dc20a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:02.326675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ee7e8ceb-a102-4080-b604-b9b9e20dc20a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:02.327120 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ee7e8ceb-a102-4080-b604-b9b9e20dc20a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:02.327910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ee7e8ceb-a102-4080-b604-b9b9e20dc20a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:02.328351 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ee7e8ceb-a102-4080-b604-b9b9e20dc20a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:02.340663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5e9176be-bf71-4773-aedf-4656f049c1cf tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:02.341307 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5e9176be-bf71-4773-aedf-4656f049c1cf tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:02.347646 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5e9176be-bf71-4773-aedf-4656f049c1cf tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:02.348443 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5e9176be-bf71-4773-aedf-4656f049c1cf tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:02.349248 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5e9176be-bf71-4773-aedf-4656f049c1cf tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:02.349682 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5e9176be-bf71-4773-aedf-4656f049c1cf tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:02.464601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ee7e8ceb-a102-4080-b604-b9b9e20dc20a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:02.472087 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ee7e8ceb-a102-4080-b604-b9b9e20dc20a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.156966 Jun 16 12:04:02.472655 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 500/963] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:02 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:02.485153 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5e9176be-bf71-4773-aedf-4656f049c1cf tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:02.492419 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5e9176be-bf71-4773-aedf-4656f049c1cf tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.155591 Jun 16 12:04:02.492962 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 464/964] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:02 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:04:02.998080 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-99556025-9db1-48bd-a9d5-0206cb620c5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:02.998573 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-99556025-9db1-48bd-a9d5-0206cb620c5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:03.004575 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-99556025-9db1-48bd-a9d5-0206cb620c5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:03.005010 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-99556025-9db1-48bd-a9d5-0206cb620c5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:03.005761 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-99556025-9db1-48bd-a9d5-0206cb620c5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:03.006191 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-99556025-9db1-48bd-a9d5-0206cb620c5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:03.030183 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-99556025-9db1-48bd-a9d5-0206cb620c5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:04:03.062595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:03.267519 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-99556025-9db1-48bd-a9d5-0206cb620c5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "DELETE /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 204 len: 0 microversion: 2.1 time: 0.273004 Jun 16 12:04:03.268021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 501/965] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:04:02 2022] DELETE /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:04:03.276100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b04ce196-9805-4e7f-a36b-d6ee865d323c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:03.277826 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b04ce196-9805-4e7f-a36b-d6ee865d323c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:03.283632 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b04ce196-9805-4e7f-a36b-d6ee865d323c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:03.284164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b04ce196-9805-4e7f-a36b-d6ee865d323c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:03.284949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b04ce196-9805-4e7f-a36b-d6ee865d323c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:03.285383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b04ce196-9805-4e7f-a36b-d6ee865d323c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:03.417978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b04ce196-9805-4e7f-a36b-d6ee865d323c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:03.425624 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b04ce196-9805-4e7f-a36b-d6ee865d323c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1579 microversion: 2.1 time: 0.153506 Jun 16 12:04:03.426189 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 465/966] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:03 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:03.490284 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-00a36894-c312-48df-87a2-f9396817eb9a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:03.490982 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-00a36894-c312-48df-87a2-f9396817eb9a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:03.497426 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-00a36894-c312-48df-87a2-f9396817eb9a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:03.497866 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-00a36894-c312-48df-87a2-f9396817eb9a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:03.498622 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-00a36894-c312-48df-87a2-f9396817eb9a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:03.499053 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-00a36894-c312-48df-87a2-f9396817eb9a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:03.509560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e3fe2abc-3705-4bb1-ba23-eb1b32066247 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:03.510164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e3fe2abc-3705-4bb1-ba23-eb1b32066247 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:03.512601 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:03.517275 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e3fe2abc-3705-4bb1-ba23-eb1b32066247 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:03.523777 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e3fe2abc-3705-4bb1-ba23-eb1b32066247 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:03.523777 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e3fe2abc-3705-4bb1-ba23-eb1b32066247 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:03.523777 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e3fe2abc-3705-4bb1-ba23-eb1b32066247 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:03.638149 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-00a36894-c312-48df-87a2-f9396817eb9a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:03.645732 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-00a36894-c312-48df-87a2-f9396817eb9a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.159580 Jun 16 12:04:03.646306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 502/967] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:03 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:03.656477 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e3fe2abc-3705-4bb1-ba23-eb1b32066247 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:03.660054 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:03.664407 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e3fe2abc-3705-4bb1-ba23-eb1b32066247 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.158779 Jun 16 12:04:03.664959 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 466/968] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:03 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:04:04.442595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-32df1625-98b8-4bb0-95bc-1cddba07f5aa tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:04.443141 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-32df1625-98b8-4bb0-95bc-1cddba07f5aa tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:04.449582 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-32df1625-98b8-4bb0-95bc-1cddba07f5aa tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:04.450024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-32df1625-98b8-4bb0-95bc-1cddba07f5aa tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:04.450815 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-32df1625-98b8-4bb0-95bc-1cddba07f5aa tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:04.451247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-32df1625-98b8-4bb0-95bc-1cddba07f5aa tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:04.584824 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-32df1625-98b8-4bb0-95bc-1cddba07f5aa tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:04.593156 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-32df1625-98b8-4bb0-95bc-1cddba07f5aa tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1579 microversion: 2.1 time: 0.154424 Jun 16 12:04:04.593718 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 503/969] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:04 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:04.662621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ff1d0920-587d-408f-ae08-c24f47de24ee tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:04.663266 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ff1d0920-587d-408f-ae08-c24f47de24ee tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:04.671515 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff1d0920-587d-408f-ae08-c24f47de24ee tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:04.676868 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff1d0920-587d-408f-ae08-c24f47de24ee tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:04.676868 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff1d0920-587d-408f-ae08-c24f47de24ee tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:04.676868 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ff1d0920-587d-408f-ae08-c24f47de24ee tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:04.681261 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-15c617a0-98fe-4700-b072-241ebc3cf936 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:04.681865 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-15c617a0-98fe-4700-b072-241ebc3cf936 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:04.687943 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15c617a0-98fe-4700-b072-241ebc3cf936 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:04.688438 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15c617a0-98fe-4700-b072-241ebc3cf936 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:04.689394 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15c617a0-98fe-4700-b072-241ebc3cf936 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:04.689822 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-15c617a0-98fe-4700-b072-241ebc3cf936 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:04.806415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ff1d0920-587d-408f-ae08-c24f47de24ee tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:04.814171 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ff1d0920-587d-408f-ae08-c24f47de24ee tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.155489 Jun 16 12:04:04.814733 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 467/970] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:04 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:04.822222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-15c617a0-98fe-4700-b072-241ebc3cf936 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:04.830086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-15c617a0-98fe-4700-b072-241ebc3cf936 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.153214 Jun 16 12:04:04.830634 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 504/971] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:04 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:04:05.610736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d8ca3ef1-2f72-4f4b-a01a-9c14596121bc tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:05.611319 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d8ca3ef1-2f72-4f4b-a01a-9c14596121bc tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:05.613199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:05.613843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=6 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:05.618581 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d8ca3ef1-2f72-4f4b-a01a-9c14596121bc tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:05.619023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d8ca3ef1-2f72-4f4b-a01a-9c14596121bc tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:05.619776 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d8ca3ef1-2f72-4f4b-a01a-9c14596121bc tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:05.620230 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d8ca3ef1-2f72-4f4b-a01a-9c14596121bc tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:05.764590 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d8ca3ef1-2f72-4f4b-a01a-9c14596121bc tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:05.766134 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d8ca3ef1-2f72-4f4b-a01a-9c14596121bc tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1579 microversion: 2.1 time: 0.159953 Jun 16 12:04:05.766702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 468/972] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:05 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:05.832945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c733d2cc-0067-450d-84db-adb136103b6a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:05.833666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c733d2cc-0067-450d-84db-adb136103b6a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:05.839551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=6 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:05.841193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:05.846853 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c733d2cc-0067-450d-84db-adb136103b6a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:05.847312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c733d2cc-0067-450d-84db-adb136103b6a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:05.848000 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6f7c916c-324b-49ad-9a40-7b2f8af54c77 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:05.848388 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c733d2cc-0067-450d-84db-adb136103b6a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:05.848828 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c733d2cc-0067-450d-84db-adb136103b6a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:05.848980 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6f7c916c-324b-49ad-9a40-7b2f8af54c77 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:05.855531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6f7c916c-324b-49ad-9a40-7b2f8af54c77 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:05.856258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6f7c916c-324b-49ad-9a40-7b2f8af54c77 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:05.857536 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6f7c916c-324b-49ad-9a40-7b2f8af54c77 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:05.858561 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6f7c916c-324b-49ad-9a40-7b2f8af54c77 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:06.000114 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c733d2cc-0067-450d-84db-adb136103b6a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:06.008026 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c733d2cc-0067-450d-84db-adb136103b6a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.178949 Jun 16 12:04:06.008705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 505/973] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:05 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:06.050499 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6f7c916c-324b-49ad-9a40-7b2f8af54c77 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:06.058272 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6f7c916c-324b-49ad-9a40-7b2f8af54c77 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.214640 Jun 16 12:04:06.059987 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 469/974] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:05 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:06.546041 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-acb079e9-9457-44ea-a66d-08bff93ce326 req-49a5c619-2b01-4735-b304-1f767d9e5a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4221add6-1a15-44e5-b48a-6a62e0a302ef", "name": "network-vif-plugged", "status": "completed", "tag": "167cae65-c8a1-4d89-8e20-2f8457a0736c"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:06.555348 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-acb079e9-9457-44ea-a66d-08bff93ce326 req-49a5c619-2b01-4735-b304-1f767d9e5a98 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:06.555789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-acb079e9-9457-44ea-a66d-08bff93ce326 req-49a5c619-2b01-4735-b304-1f767d9e5a98 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:06.566610 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-acb079e9-9457-44ea-a66d-08bff93ce326 req-49a5c619-2b01-4735-b304-1f767d9e5a98 service nova] Creating event network-vif-plugged:167cae65-c8a1-4d89-8e20-2f8457a0736c for instance 4221add6-1a15-44e5-b48a-6a62e0a302ef on hv-cinder-84614 Jun 16 12:04:06.571500 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-acb079e9-9457-44ea-a66d-08bff93ce326 req-49a5c619-2b01-4735-b304-1f767d9e5a98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030053 Jun 16 12:04:06.572102 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 506/975] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:04:06.789275 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ca19a433-1f15-4756-9449-d0fefb19a229 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:06.790949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ca19a433-1f15-4756-9449-d0fefb19a229 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:06.799213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ca19a433-1f15-4756-9449-d0fefb19a229 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:06.799909 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ca19a433-1f15-4756-9449-d0fefb19a229 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:06.800861 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ca19a433-1f15-4756-9449-d0fefb19a229 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:06.802407 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ca19a433-1f15-4756-9449-d0fefb19a229 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.026560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a1b35354-2fe5-4ba3-a547-2a9364efd3b9 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:07.027327 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a1b35354-2fe5-4ba3-a547-2a9364efd3b9 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:07.034897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a1b35354-2fe5-4ba3-a547-2a9364efd3b9 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.039547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a1b35354-2fe5-4ba3-a547-2a9364efd3b9 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.039547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a1b35354-2fe5-4ba3-a547-2a9364efd3b9 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.039547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a1b35354-2fe5-4ba3-a547-2a9364efd3b9 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.191978 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ca19a433-1f15-4756-9449-d0fefb19a229 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:07.195808 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a1b35354-2fe5-4ba3-a547-2a9364efd3b9 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:07.205252 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a1b35354-2fe5-4ba3-a547-2a9364efd3b9 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1568 microversion: 2.1 time: 0.183469 Jun 16 12:04:07.206084 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 507/976] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:07 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:07.208022 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ca19a433-1f15-4756-9449-d0fefb19a229 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1511 microversion: 2.1 time: 0.428933 Jun 16 12:04:07.211269 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 470/977] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:06 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:07.212338 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-070e665d-aefe-4716-bdab-3c3eb543f56a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:07.213117 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-070e665d-aefe-4716-bdab-3c3eb543f56a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:07.219541 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-070e665d-aefe-4716-bdab-3c3eb543f56a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.220023 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-070e665d-aefe-4716-bdab-3c3eb543f56a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.220791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-070e665d-aefe-4716-bdab-3c3eb543f56a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.221398 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-070e665d-aefe-4716-bdab-3c3eb543f56a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.225310 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-69fc4aaa-a35e-40e9-a48a-6d2c326f05b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:07.226265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-69fc4aaa-a35e-40e9-a48a-6d2c326f05b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:07.233281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-69fc4aaa-a35e-40e9-a48a-6d2c326f05b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.234026 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-69fc4aaa-a35e-40e9-a48a-6d2c326f05b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.234885 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-69fc4aaa-a35e-40e9-a48a-6d2c326f05b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.235719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-69fc4aaa-a35e-40e9-a48a-6d2c326f05b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.386078 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-070e665d-aefe-4716-bdab-3c3eb543f56a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:07.394036 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-070e665d-aefe-4716-bdab-3c3eb543f56a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.185866 Jun 16 12:04:07.394686 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 508/978] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:07 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:07.399266 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-9e258222-2795-4e58-9297-684a9201e877 req-1cd78723-a73b-4842-81f0-09df2f81a436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a1b425-5720-4f35-ad2e-89ae357c62c5", "name": "network-vif-deleted", "tag": "7f468ee4-db76-4173-bece-42f1456f6426"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:07.408514 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-9e258222-2795-4e58-9297-684a9201e877 req-1cd78723-a73b-4842-81f0-09df2f81a436 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.409108 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-9e258222-2795-4e58-9297-684a9201e877 req-1cd78723-a73b-4842-81f0-09df2f81a436 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.422211 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-9e258222-2795-4e58-9297-684a9201e877 req-1cd78723-a73b-4842-81f0-09df2f81a436 service nova] Creating event network-vif-deleted:7f468ee4-db76-4173-bece-42f1456f6426 for instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 on hv-cinder-84614 Jun 16 12:04:07.427289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-9e258222-2795-4e58-9297-684a9201e877 req-1cd78723-a73b-4842-81f0-09df2f81a436 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031469 Jun 16 12:04:07.428007 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 509/979] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:04:07.560072 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-69fc4aaa-a35e-40e9-a48a-6d2c326f05b0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "POST /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276/action" status: 202 len: 0 microversion: 2.1 time: 0.338983 Jun 16 12:04:07.560939 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 471/980] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 12:04:07 2022] POST /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:04:07.569840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-81f6dbed-ee86-43a7-b816-25c96909e9e3 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:07.570830 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-81f6dbed-ee86-43a7-b816-25c96909e9e3 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:07.577373 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81f6dbed-ee86-43a7-b816-25c96909e9e3 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.578054 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81f6dbed-ee86-43a7-b816-25c96909e9e3 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.579100 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81f6dbed-ee86-43a7-b816-25c96909e9e3 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:07.579812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-81f6dbed-ee86-43a7-b816-25c96909e9e3 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:07.722219 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-81f6dbed-ee86-43a7-b816-25c96909e9e3 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:07.732812 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-81f6dbed-ee86-43a7-b816-25c96909e9e3 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1516 microversion: 2.1 time: 0.167567 Jun 16 12:04:07.734123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 510/981] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:07 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:08.227422 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:08.228065 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:08.234198 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:08.234635 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:08.235391 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:08.235949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:08.270459 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:08.271160 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:08.271599 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lazy-loading 'fault' on Instance uuid 05a1b425-5720-4f35-ad2e-89ae357c62c5 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:04:08.317740 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:08.326933 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f625b975-45bc-4e1e-ab9c-2dfcbd0fe10a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1231 microversion: 2.1 time: 0.104173 Jun 16 12:04:08.327718 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 472/982] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:08 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:08.413464 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a93d9d19-bdc2-430b-8fa2-5b1117ed7345 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:08.415187 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a93d9d19-bdc2-430b-8fa2-5b1117ed7345 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:08.431586 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a93d9d19-bdc2-430b-8fa2-5b1117ed7345 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:08.432059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a93d9d19-bdc2-430b-8fa2-5b1117ed7345 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:08.432984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a93d9d19-bdc2-430b-8fa2-5b1117ed7345 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:08.436433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a93d9d19-bdc2-430b-8fa2-5b1117ed7345 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:08.586847 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-2eb5a4b6-6e2f-4503-a3c0-abc15e53a068 req-eb4218d4-9b24-45e2-bb92-e18e915bb20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b481fc54-9d0a-4ce3-a4f8-651a22d1d276", "name": "network-vif-unplugged", "status": "completed", "tag": "7856f81f-be70-45db-80ed-79a45bca3b14"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:08.590473 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a93d9d19-bdc2-430b-8fa2-5b1117ed7345 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:08.598799 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a93d9d19-bdc2-430b-8fa2-5b1117ed7345 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1367 microversion: 2.1 time: 0.189072 Jun 16 12:04:08.600174 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 511/983] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:08 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:08.603478 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-2eb5a4b6-6e2f-4503-a3c0-abc15e53a068 req-eb4218d4-9b24-45e2-bb92-e18e915bb20a service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:08.603936 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-2eb5a4b6-6e2f-4503-a3c0-abc15e53a068 req-eb4218d4-9b24-45e2-bb92-e18e915bb20a service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:08.616952 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.compute.server_external_events [req-2eb5a4b6-6e2f-4503-a3c0-abc15e53a068 req-eb4218d4-9b24-45e2-bb92-e18e915bb20a service nova] Unable to find a host for instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276. Dropping event network-vif-unplugged {{(pid=125055) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 12:04:08.617824 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-2eb5a4b6-6e2f-4503-a3c0-abc15e53a068 req-eb4218d4-9b24-45e2-bb92-e18e915bb20a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034842 Jun 16 12:04:08.618404 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 473/984] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 12:04:08.754453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-31639a6f-aae4-4cbc-ae03-beaca13b19b1 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:08.758121 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-31639a6f-aae4-4cbc-ae03-beaca13b19b1 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:08.769111 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-31639a6f-aae4-4cbc-ae03-beaca13b19b1 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:08.771983 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-31639a6f-aae4-4cbc-ae03-beaca13b19b1 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:08.772982 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-31639a6f-aae4-4cbc-ae03-beaca13b19b1 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:08.775976 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-31639a6f-aae4-4cbc-ae03-beaca13b19b1 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:08.923079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-31639a6f-aae4-4cbc-ae03-beaca13b19b1 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:08.930791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-31639a6f-aae4-4cbc-ae03-beaca13b19b1 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1516 microversion: 2.1 time: 0.183883 Jun 16 12:04:08.931371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 512/985] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:08 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:09.346463 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:09.347191 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:09.354687 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:09.355347 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:09.356580 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:09.358021 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:09.399358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:09.399973 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:09.400423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lazy-loading 'fault' on Instance uuid 05a1b425-5720-4f35-ad2e-89ae357c62c5 {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:04:09.449921 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:09.457907 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-044bb143-212c-4473-b04d-082d1242561f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 200 len: 1231 microversion: 2.1 time: 0.115838 Jun 16 12:04:09.458667 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 474/986] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:09 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 1231 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:09.616675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-88ccc634-a054-415b-b7d3-670eff548a60 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:09.617313 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-88ccc634-a054-415b-b7d3-670eff548a60 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:09.624965 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-88ccc634-a054-415b-b7d3-670eff548a60 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:09.625439 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-88ccc634-a054-415b-b7d3-670eff548a60 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:09.632073 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-88ccc634-a054-415b-b7d3-670eff548a60 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:09.632073 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-88ccc634-a054-415b-b7d3-670eff548a60 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:09.948111 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-081b3d86-6e5b-480f-acff-b4f92d31846e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:09.949475 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-081b3d86-6e5b-480f-acff-b4f92d31846e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:09.955566 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-081b3d86-6e5b-480f-acff-b4f92d31846e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:09.956037 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-081b3d86-6e5b-480f-acff-b4f92d31846e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:09.956801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-081b3d86-6e5b-480f-acff-b4f92d31846e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:09.957226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-081b3d86-6e5b-480f-acff-b4f92d31846e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:10.053841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-88ccc634-a054-415b-b7d3-670eff548a60 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:10.063996 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-88ccc634-a054-415b-b7d3-670eff548a60 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1557 microversion: 2.1 time: 0.451004 Jun 16 12:04:10.064826 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 513/987] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:09 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1557 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:10.080945 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ce3cab72-01a6-464c-93fc-cf8ae6f59cb0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:10.081737 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ce3cab72-01a6-464c-93fc-cf8ae6f59cb0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:10.087947 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce3cab72-01a6-464c-93fc-cf8ae6f59cb0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:10.089460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce3cab72-01a6-464c-93fc-cf8ae6f59cb0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:10.089460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce3cab72-01a6-464c-93fc-cf8ae6f59cb0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:10.089714 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ce3cab72-01a6-464c-93fc-cf8ae6f59cb0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:10.098147 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-081b3d86-6e5b-480f-acff-b4f92d31846e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:10.107820 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-081b3d86-6e5b-480f-acff-b4f92d31846e tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1518 microversion: 2.1 time: 0.163560 Jun 16 12:04:10.109037 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 475/988] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:09 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:04:10.166915 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ce3cab72-01a6-464c-93fc-cf8ae6f59cb0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089727 Jun 16 12:04:10.168059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 514/989] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 12:04:10 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:04:10.475095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:10.475890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:10.483575 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:10.484053 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:10.484890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:10.485325 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:10.499021 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] HTTP exception thrown: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Request method failure captured: Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 HTTP/1.1 Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxt-Xvxsep5dA8u4CCgG3njaeWh3awGfyGozF3kYATpsWxt_42mPDKK4zykXOHiYRzyWuD3JMN-5lSEY2YZPZgAKbCr72ZZNPwTuXJtos9VLZVFR7kEs0jqIu8IdQGODSdeV0Df2ogizu3u1pQkN0wBbBMJlxFiDkoRf8fOy3ssD01o Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:04:10.500694 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-TestVolumeBootPattern-887041558 Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: f6e726651e4c49b794f5c86e1fe51d9c Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:04:10.503172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '05a1b425-5720-4f35-ad2e-89ae357c62c5'} Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:04:10.504203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:04:10.505726 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:04:10.507046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Returning 404 to user: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:04:10.507046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-de848f3e-47f9-4757-9cb9-b1f8d0b9f682 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 404 len: 111 microversion: 2.1 time: 0.031322 Jun 16 12:04:10.507046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 476/990] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:10 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:04:10.621289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1151100702", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1690805727", "security_groups": [{"name": "tempest-secgroup-smoke-1884746139"}], "block_device_mapping_v2": [{"uuid": "8752edc7-535e-4d22-9cd2-c8410da73792", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a6f2fc51-0593-4393-8bad-bf4f67840cba"}]}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:10.745949 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] validate_networks() for [('a6f2fc51-0593-4393-8bad-bf4f67840cba', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:04:11.126209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ad7966b3-7b6c-465d-b572-98aca9cc7b02 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:11.127195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ad7966b3-7b6c-465d-b572-98aca9cc7b02 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:11.133881 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ad7966b3-7b6c-465d-b572-98aca9cc7b02 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:11.134632 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ad7966b3-7b6c-465d-b572-98aca9cc7b02 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:11.135569 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ad7966b3-7b6c-465d-b572-98aca9cc7b02 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:11.136322 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ad7966b3-7b6c-465d-b572-98aca9cc7b02 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:11.385384 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-ad7966b3-7b6c-465d-b572-98aca9cc7b02 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:11.394276 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ad7966b3-7b6c-465d-b572-98aca9cc7b02 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.271847 Jun 16 12:04:11.395061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 477/991] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:11 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:04:11.446138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:04:11.446554 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:04:11.447188 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:04:11.447786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:04:11.448367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:04:11.461007 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:11.461643 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:11.462896 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:11.463490 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:11.486948 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Getting quotas for project 4be7fa7276cb42d3a8b6dd0dd12cd784. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:04:11.491652 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Getting quotas for user f6e726651e4c49b794f5c86e1fe51d9c and project 4be7fa7276cb42d3a8b6dd0dd12cd784. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:04:11.506910 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-5712f70b-bb4a-418d-9256-a0227faa4f9c req-c906fd51-c55a-42eb-89fe-ce5cbe1ac8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4221add6-1a15-44e5-b48a-6a62e0a302ef", "tag": "167cae65-c8a1-4d89-8e20-2f8457a0736c"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:11.517269 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-5712f70b-bb4a-418d-9256-a0227faa4f9c req-c906fd51-c55a-42eb-89fe-ce5cbe1ac8d8 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:11.517711 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-5712f70b-bb4a-418d-9256-a0227faa4f9c req-c906fd51-c55a-42eb-89fe-ce5cbe1ac8d8 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:11.531245 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-5712f70b-bb4a-418d-9256-a0227faa4f9c req-c906fd51-c55a-42eb-89fe-ce5cbe1ac8d8 service nova] Creating event network-changed:167cae65-c8a1-4d89-8e20-2f8457a0736c for instance 4221add6-1a15-44e5-b48a-6a62e0a302ef on hv-cinder-84614 Jun 16 12:04:11.536917 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-5712f70b-bb4a-418d-9256-a0227faa4f9c req-c906fd51-c55a-42eb-89fe-ce5cbe1ac8d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033885 Jun 16 12:04:11.540757 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 478/992] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:04:11.584095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:04:11.584095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8752edc7-535e-4d22-9cd2-c8410da73792',volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:04:12.050445 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-3d8dbff0-a7ee-4361-9bad-d59f855d4a1e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.433100 Jun 16 12:04:12.063258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-64e9ed68-5f7d-4c13-ad15-a05d21e6fec2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:12.063985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-64e9ed68-5f7d-4c13-ad15-a05d21e6fec2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:12.067122 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 515/993] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:04:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:04:12.135651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-64e9ed68-5f7d-4c13-ad15-a05d21e6fec2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:12.159546 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-64e9ed68-5f7d-4c13-ad15-a05d21e6fec2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1095 microversion: 2.1 time: 0.101768 Jun 16 12:04:12.160189 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 479/994] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:12 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:04:12.412286 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-43b7ae78-92f3-4b03-b9e4-56434332c5c2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:12.413049 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-43b7ae78-92f3-4b03-b9e4-56434332c5c2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:12.420158 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-43b7ae78-92f3-4b03-b9e4-56434332c5c2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:12.420841 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-43b7ae78-92f3-4b03-b9e4-56434332c5c2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:12.421802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-43b7ae78-92f3-4b03-b9e4-56434332c5c2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:12.422235 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-43b7ae78-92f3-4b03-b9e4-56434332c5c2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:12.586682 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-43b7ae78-92f3-4b03-b9e4-56434332c5c2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:12.597275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-43b7ae78-92f3-4b03-b9e4-56434332c5c2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.189020 Jun 16 12:04:12.607938 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 516/995] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:12 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:13.176598 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b435e4a4-87e7-41d6-90df-4a7c86e2f459 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:13.177199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b435e4a4-87e7-41d6-90df-4a7c86e2f459 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:13.186035 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b435e4a4-87e7-41d6-90df-4a7c86e2f459 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:13.186460 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b435e4a4-87e7-41d6-90df-4a7c86e2f459 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:13.187219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b435e4a4-87e7-41d6-90df-4a7c86e2f459 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:13.187924 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b435e4a4-87e7-41d6-90df-4a7c86e2f459 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:13.254228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-b435e4a4-87e7-41d6-90df-4a7c86e2f459 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:13.263474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b435e4a4-87e7-41d6-90df-4a7c86e2f459 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1145 microversion: 2.1 time: 0.090674 Jun 16 12:04:13.264271 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 480/996] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:13 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:13.614616 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0553a821-7c27-494f-892c-1c8f9aa795a0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:13.615824 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0553a821-7c27-494f-892c-1c8f9aa795a0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:13.622588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0553a821-7c27-494f-892c-1c8f9aa795a0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:13.623028 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0553a821-7c27-494f-892c-1c8f9aa795a0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:13.624014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0553a821-7c27-494f-892c-1c8f9aa795a0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:13.624329 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0553a821-7c27-494f-892c-1c8f9aa795a0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:13.757199 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0553a821-7c27-494f-892c-1c8f9aa795a0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:13.765680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0553a821-7c27-494f-892c-1c8f9aa795a0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.154806 Jun 16 12:04:13.773021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 517/997] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:13 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:14.282714 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-63873bee-32dd-4692-8277-fdd4981818e9 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:14.283326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-63873bee-32dd-4692-8277-fdd4981818e9 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:14.289772 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63873bee-32dd-4692-8277-fdd4981818e9 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:14.290222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63873bee-32dd-4692-8277-fdd4981818e9 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:14.290988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63873bee-32dd-4692-8277-fdd4981818e9 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:14.291423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-63873bee-32dd-4692-8277-fdd4981818e9 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:14.373541 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-63873bee-32dd-4692-8277-fdd4981818e9 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:14.384689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-63873bee-32dd-4692-8277-fdd4981818e9 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1211 microversion: 2.1 time: 0.105407 Jun 16 12:04:14.387120 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 481/998] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:14 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:14.783021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-074d5750-9261-4ea7-b571-bf5b51941d30 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:14.783636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-074d5750-9261-4ea7-b571-bf5b51941d30 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:14.791390 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-074d5750-9261-4ea7-b571-bf5b51941d30 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:14.791843 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-074d5750-9261-4ea7-b571-bf5b51941d30 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:14.793132 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-074d5750-9261-4ea7-b571-bf5b51941d30 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:14.793576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-074d5750-9261-4ea7-b571-bf5b51941d30 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:14.951548 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-074d5750-9261-4ea7-b571-bf5b51941d30 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:14.965092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-074d5750-9261-4ea7-b571-bf5b51941d30 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.184712 Jun 16 12:04:14.965092 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 518/999] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:14 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:15.403734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-989cdfbd-5175-4e3a-a806-5e84ee1ca2fe tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:15.404387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-989cdfbd-5175-4e3a-a806-5e84ee1ca2fe tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:15.410895 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-989cdfbd-5175-4e3a-a806-5e84ee1ca2fe tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:15.411337 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-989cdfbd-5175-4e3a-a806-5e84ee1ca2fe tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:15.412136 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-989cdfbd-5175-4e3a-a806-5e84ee1ca2fe tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:15.413452 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-989cdfbd-5175-4e3a-a806-5e84ee1ca2fe tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:15.616099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-989cdfbd-5175-4e3a-a806-5e84ee1ca2fe tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:15.624295 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-989cdfbd-5175-4e3a-a806-5e84ee1ca2fe tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1267 microversion: 2.1 time: 0.225221 Jun 16 12:04:15.625070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 482/1000] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:15 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:15.802217 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-57a17ffb-1181-4d9c-bcf7-51f01b2a0a2c req-2d764cf4-6a79-481b-9a26-def0a5559324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8280b475-f6b8-4343-94ec-0e606c828d02", "tag": "6beb28f2-29cf-4f4d-9979-acede16177be"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:15.818686 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-57a17ffb-1181-4d9c-bcf7-51f01b2a0a2c req-2d764cf4-6a79-481b-9a26-def0a5559324 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:15.820428 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-57a17ffb-1181-4d9c-bcf7-51f01b2a0a2c req-2d764cf4-6a79-481b-9a26-def0a5559324 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:15.836874 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-57a17ffb-1181-4d9c-bcf7-51f01b2a0a2c req-2d764cf4-6a79-481b-9a26-def0a5559324 service nova] Creating event network-changed:6beb28f2-29cf-4f4d-9979-acede16177be for instance 8280b475-f6b8-4343-94ec-0e606c828d02 on hv-cinder-84614 Jun 16 12:04:15.842813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-57a17ffb-1181-4d9c-bcf7-51f01b2a0a2c req-2d764cf4-6a79-481b-9a26-def0a5559324 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045783 Jun 16 12:04:15.843731 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 519/1001] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:04:15.982317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-dcc20f39-aac2-40fd-98d0-fad110084741 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:15.982940 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-dcc20f39-aac2-40fd-98d0-fad110084741 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:15.989743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dcc20f39-aac2-40fd-98d0-fad110084741 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:15.990194 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dcc20f39-aac2-40fd-98d0-fad110084741 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:15.991244 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dcc20f39-aac2-40fd-98d0-fad110084741 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:15.991972 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dcc20f39-aac2-40fd-98d0-fad110084741 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:16.206415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-dcc20f39-aac2-40fd-98d0-fad110084741 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:16.216170 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-dcc20f39-aac2-40fd-98d0-fad110084741 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.238362 Jun 16 12:04:16.218342 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 483/1002] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:15 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:16.643677 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bd882adc-9bb3-4ec8-b813-f5b3f7141d98 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:16.644503 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bd882adc-9bb3-4ec8-b813-f5b3f7141d98 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:16.651570 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd882adc-9bb3-4ec8-b813-f5b3f7141d98 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:16.652162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd882adc-9bb3-4ec8-b813-f5b3f7141d98 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:16.652931 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd882adc-9bb3-4ec8-b813-f5b3f7141d98 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:16.653362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd882adc-9bb3-4ec8-b813-f5b3f7141d98 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:16.799411 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bd882adc-9bb3-4ec8-b813-f5b3f7141d98 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:16.802949 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:16.807193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bd882adc-9bb3-4ec8-b813-f5b3f7141d98 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1267 microversion: 2.1 time: 0.168516 Jun 16 12:04:16.807749 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 520/1003] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:16 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:17.233636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d5a4da33-db8e-400b-a88d-7bc243d24a5a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:17.234266 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d5a4da33-db8e-400b-a88d-7bc243d24a5a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:17.240754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d5a4da33-db8e-400b-a88d-7bc243d24a5a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:17.241195 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d5a4da33-db8e-400b-a88d-7bc243d24a5a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:17.241953 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d5a4da33-db8e-400b-a88d-7bc243d24a5a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:17.242377 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d5a4da33-db8e-400b-a88d-7bc243d24a5a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:17.373502 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d5a4da33-db8e-400b-a88d-7bc243d24a5a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:17.377282 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:17.381718 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d5a4da33-db8e-400b-a88d-7bc243d24a5a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.152104 Jun 16 12:04:17.382281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 484/1004] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:17 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:17.823697 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6f5607dc-c495-4778-8711-3dbb7b345945 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:17.824289 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6f5607dc-c495-4778-8711-3dbb7b345945 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:17.831651 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6f5607dc-c495-4778-8711-3dbb7b345945 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:17.831764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6f5607dc-c495-4778-8711-3dbb7b345945 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:17.832542 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6f5607dc-c495-4778-8711-3dbb7b345945 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:17.832981 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6f5607dc-c495-4778-8711-3dbb7b345945 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:17.973088 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6f5607dc-c495-4778-8711-3dbb7b345945 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:17.981287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6f5607dc-c495-4778-8711-3dbb7b345945 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1267 microversion: 2.1 time: 0.161935 Jun 16 12:04:17.984974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 521/1005] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:17 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:18.400575 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9b91308a-2870-4e58-a224-5d49d2262472 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:18.401263 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9b91308a-2870-4e58-a224-5d49d2262472 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:18.409609 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b91308a-2870-4e58-a224-5d49d2262472 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:18.413883 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b91308a-2870-4e58-a224-5d49d2262472 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:18.413883 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b91308a-2870-4e58-a224-5d49d2262472 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:18.413883 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9b91308a-2870-4e58-a224-5d49d2262472 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:18.543108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9b91308a-2870-4e58-a224-5d49d2262472 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:18.550547 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9b91308a-2870-4e58-a224-5d49d2262472 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.153875 Jun 16 12:04:18.551107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 485/1006] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:18 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:19.000079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a6b53d48-aecb-4b0b-909d-6b2ed09c1c3a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:19.000694 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a6b53d48-aecb-4b0b-909d-6b2ed09c1c3a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:19.006651 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6b53d48-aecb-4b0b-909d-6b2ed09c1c3a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:19.007094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6b53d48-aecb-4b0b-909d-6b2ed09c1c3a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:19.007852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6b53d48-aecb-4b0b-909d-6b2ed09c1c3a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:19.008312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6b53d48-aecb-4b0b-909d-6b2ed09c1c3a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:19.141834 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a6b53d48-aecb-4b0b-909d-6b2ed09c1c3a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:19.149557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a6b53d48-aecb-4b0b-909d-6b2ed09c1c3a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1267 microversion: 2.1 time: 0.154035 Jun 16 12:04:19.150377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 522/1007] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:18 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:19.567386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d91d3f92-eff4-476d-b634-6f5df61c48f2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:19.568129 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d91d3f92-eff4-476d-b634-6f5df61c48f2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:19.575121 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d91d3f92-eff4-476d-b634-6f5df61c48f2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:19.575569 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d91d3f92-eff4-476d-b634-6f5df61c48f2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:19.576373 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d91d3f92-eff4-476d-b634-6f5df61c48f2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:19.576807 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d91d3f92-eff4-476d-b634-6f5df61c48f2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:19.709239 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d91d3f92-eff4-476d-b634-6f5df61c48f2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:19.717596 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d91d3f92-eff4-476d-b634-6f5df61c48f2 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.154057 Jun 16 12:04:19.718165 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 486/1008] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:19 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:20.166474 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2de7e1ee-28e0-4367-9554-0ee8f545a095 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:20.167088 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2de7e1ee-28e0-4367-9554-0ee8f545a095 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:20.173607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2de7e1ee-28e0-4367-9554-0ee8f545a095 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:20.174059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2de7e1ee-28e0-4367-9554-0ee8f545a095 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:20.174830 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2de7e1ee-28e0-4367-9554-0ee8f545a095 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:20.175271 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2de7e1ee-28e0-4367-9554-0ee8f545a095 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:20.306844 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2de7e1ee-28e0-4367-9554-0ee8f545a095 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:20.314802 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2de7e1ee-28e0-4367-9554-0ee8f545a095 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1267 microversion: 2.1 time: 0.152147 Jun 16 12:04:20.315358 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 523/1009] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:20 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:20.735194 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fc234187-2596-4600-a336-13d0ffd2d104 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:20.735801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fc234187-2596-4600-a336-13d0ffd2d104 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:20.744672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fc234187-2596-4600-a336-13d0ffd2d104 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:20.746894 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fc234187-2596-4600-a336-13d0ffd2d104 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:20.748290 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fc234187-2596-4600-a336-13d0ffd2d104 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:20.748902 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fc234187-2596-4600-a336-13d0ffd2d104 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:20.888730 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fc234187-2596-4600-a336-13d0ffd2d104 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:20.896445 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fc234187-2596-4600-a336-13d0ffd2d104 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.165142 Jun 16 12:04:20.897022 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 487/1010] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:20 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:21.331066 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-215f18a0-83a8-4bb9-93c9-c14a5ad8a72d tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:21.331676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-215f18a0-83a8-4bb9-93c9-c14a5ad8a72d tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:21.338086 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-215f18a0-83a8-4bb9-93c9-c14a5ad8a72d tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:21.338542 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-215f18a0-83a8-4bb9-93c9-c14a5ad8a72d tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:21.340792 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-215f18a0-83a8-4bb9-93c9-c14a5ad8a72d tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:21.346600 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-215f18a0-83a8-4bb9-93c9-c14a5ad8a72d tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:21.475257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-215f18a0-83a8-4bb9-93c9-c14a5ad8a72d tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:21.477578 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:21.483583 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-215f18a0-83a8-4bb9-93c9-c14a5ad8a72d tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1267 microversion: 2.1 time: 0.156405 Jun 16 12:04:21.484245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 524/1011] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:21 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:21.914269 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9582ff54-2a5e-4287-96f0-5cef589d7ca6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:21.914938 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9582ff54-2a5e-4287-96f0-5cef589d7ca6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:21.921788 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9582ff54-2a5e-4287-96f0-5cef589d7ca6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:21.922139 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9582ff54-2a5e-4287-96f0-5cef589d7ca6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:21.926712 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9582ff54-2a5e-4287-96f0-5cef589d7ca6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:21.926712 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9582ff54-2a5e-4287-96f0-5cef589d7ca6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:22.055698 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-9582ff54-2a5e-4287-96f0-5cef589d7ca6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:22.063273 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9582ff54-2a5e-4287-96f0-5cef589d7ca6 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.152779 Jun 16 12:04:22.063841 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 488/1012] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:21 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:22.500906 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-82dfb854-1968-41fc-8ee1-66a774f28e2b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:22.501607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-82dfb854-1968-41fc-8ee1-66a774f28e2b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:22.503435 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=6 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:22.508754 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-82dfb854-1968-41fc-8ee1-66a774f28e2b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:22.509201 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-82dfb854-1968-41fc-8ee1-66a774f28e2b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:22.509954 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-82dfb854-1968-41fc-8ee1-66a774f28e2b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:22.510384 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-82dfb854-1968-41fc-8ee1-66a774f28e2b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:22.609613 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-1531a8b0-961b-4bb8-a681-021ac885fe0b req-c4f9e13a-f2d4-4bfe-a120-70f1b1765ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8280b475-f6b8-4343-94ec-0e606c828d02", "name": "network-vif-plugged", "status": "completed", "tag": "6beb28f2-29cf-4f4d-9979-acede16177be"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:22.614622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:22.620178 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-1531a8b0-961b-4bb8-a681-021ac885fe0b req-c4f9e13a-f2d4-4bfe-a120-70f1b1765ea1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:22.620893 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-1531a8b0-961b-4bb8-a681-021ac885fe0b req-c4f9e13a-f2d4-4bfe-a120-70f1b1765ea1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:22.634825 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-1531a8b0-961b-4bb8-a681-021ac885fe0b req-c4f9e13a-f2d4-4bfe-a120-70f1b1765ea1 service nova] Creating event network-vif-plugged:6beb28f2-29cf-4f4d-9979-acede16177be for instance 8280b475-f6b8-4343-94ec-0e606c828d02 on hv-cinder-84614 Jun 16 12:04:22.640441 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-1531a8b0-961b-4bb8-a681-021ac885fe0b req-c4f9e13a-f2d4-4bfe-a120-70f1b1765ea1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035604 Jun 16 12:04:22.641055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 489/1013] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:04:22.651178 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-82dfb854-1968-41fc-8ee1-66a774f28e2b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:22.658921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-82dfb854-1968-41fc-8ee1-66a774f28e2b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1267 microversion: 2.1 time: 0.163031 Jun 16 12:04:22.659505 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 525/1014] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:22 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:23.083390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0d1586e3-0d4f-4676-8db5-7aa2da50708a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:23.084210 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0d1586e3-0d4f-4676-8db5-7aa2da50708a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:23.091452 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0d1586e3-0d4f-4676-8db5-7aa2da50708a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:23.091890 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0d1586e3-0d4f-4676-8db5-7aa2da50708a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:23.092719 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0d1586e3-0d4f-4676-8db5-7aa2da50708a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:23.093161 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0d1586e3-0d4f-4676-8db5-7aa2da50708a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:23.223346 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0d1586e3-0d4f-4676-8db5-7aa2da50708a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:23.231725 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0d1586e3-0d4f-4676-8db5-7aa2da50708a tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.152630 Jun 16 12:04:23.232339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 490/1015] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:23 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:23.675641 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-184b1aef-ac49-4e04-81f9-00b7cbc76f5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:23.676194 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-184b1aef-ac49-4e04-81f9-00b7cbc76f5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:23.682606 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-184b1aef-ac49-4e04-81f9-00b7cbc76f5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:23.683059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-184b1aef-ac49-4e04-81f9-00b7cbc76f5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:23.684392 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-184b1aef-ac49-4e04-81f9-00b7cbc76f5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:23.684839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-184b1aef-ac49-4e04-81f9-00b7cbc76f5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:23.813998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-184b1aef-ac49-4e04-81f9-00b7cbc76f5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:23.821441 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-184b1aef-ac49-4e04-81f9-00b7cbc76f5f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1267 microversion: 2.1 time: 0.149791 Jun 16 12:04:23.823097 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 526/1016] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:23 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:24.248810 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-80e9e709-e85c-420d-a6ef-825c91719164 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:24.249417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-80e9e709-e85c-420d-a6ef-825c91719164 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:24.255861 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-80e9e709-e85c-420d-a6ef-825c91719164 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:24.256457 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-80e9e709-e85c-420d-a6ef-825c91719164 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:24.257212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-80e9e709-e85c-420d-a6ef-825c91719164 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:24.257643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-80e9e709-e85c-420d-a6ef-825c91719164 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:24.390211 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-80e9e709-e85c-420d-a6ef-825c91719164 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:24.397675 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-80e9e709-e85c-420d-a6ef-825c91719164 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.153007 Jun 16 12:04:24.403172 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 491/1017] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:24 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:24.653853 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-4e710958-1ee2-466d-b095-70b49a857941 req-80615a74-a0e8-47c7-833d-842dd49336fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b481fc54-9d0a-4ce3-a4f8-651a22d1d276", "name": "network-vif-plugged", "status": "completed", "tag": "7856f81f-be70-45db-80ed-79a45bca3b14"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:24.661927 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-4e710958-1ee2-466d-b095-70b49a857941 req-80615a74-a0e8-47c7-833d-842dd49336fa service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:24.662370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-4e710958-1ee2-466d-b095-70b49a857941 req-80615a74-a0e8-47c7-833d-842dd49336fa service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:24.673631 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-4e710958-1ee2-466d-b095-70b49a857941 req-80615a74-a0e8-47c7-833d-842dd49336fa service nova] Creating event network-vif-plugged:7856f81f-be70-45db-80ed-79a45bca3b14 for instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 on hv-cinder-84614 Jun 16 12:04:24.680722 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-4e710958-1ee2-466d-b095-70b49a857941 req-80615a74-a0e8-47c7-833d-842dd49336fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030577 Jun 16 12:04:24.681377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 527/1018] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:04:24.838120 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5328c1f2-151f-404c-85bf-5f9734173ee8 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:24.838689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5328c1f2-151f-404c-85bf-5f9734173ee8 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:24.844622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5328c1f2-151f-404c-85bf-5f9734173ee8 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:24.845064 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5328c1f2-151f-404c-85bf-5f9734173ee8 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:24.845813 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5328c1f2-151f-404c-85bf-5f9734173ee8 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:24.846252 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5328c1f2-151f-404c-85bf-5f9734173ee8 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:25.009276 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5328c1f2-151f-404c-85bf-5f9734173ee8 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:25.017632 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5328c1f2-151f-404c-85bf-5f9734173ee8 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1455 microversion: 2.1 time: 0.183428 Jun 16 12:04:25.018199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 492/1019] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:24 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1455 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:25.034045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c36fdf71-22bb-4d03-81d1-69b272c8e571 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:25.034736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c36fdf71-22bb-4d03-81d1-69b272c8e571 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:25.040831 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c36fdf71-22bb-4d03-81d1-69b272c8e571 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:25.041276 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c36fdf71-22bb-4d03-81d1-69b272c8e571 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:25.042037 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c36fdf71-22bb-4d03-81d1-69b272c8e571 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:25.042465 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c36fdf71-22bb-4d03-81d1-69b272c8e571 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:25.186123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-c36fdf71-22bb-4d03-81d1-69b272c8e571 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:25.194547 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c36fdf71-22bb-4d03-81d1-69b272c8e571 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1455 microversion: 2.1 time: 0.164480 Jun 16 12:04:25.195242 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 528/1020] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:25 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:25.419997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3526b5bd-7176-4928-ad09-2d5b5c762657 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:25.419997 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3526b5bd-7176-4928-ad09-2d5b5c762657 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:25.422451 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3526b5bd-7176-4928-ad09-2d5b5c762657 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:25.422891 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3526b5bd-7176-4928-ad09-2d5b5c762657 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:25.423641 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3526b5bd-7176-4928-ad09-2d5b5c762657 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:25.424173 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3526b5bd-7176-4928-ad09-2d5b5c762657 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:25.625783 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3526b5bd-7176-4928-ad09-2d5b5c762657 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:25.633379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3526b5bd-7176-4928-ad09-2d5b5c762657 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1574 microversion: 2.1 time: 0.222157 Jun 16 12:04:25.638289 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 493/1021] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:25 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:26.650809 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0b008e67-6448-4725-8fb1-7c46e8eb88b5 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:26.652163 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0b008e67-6448-4725-8fb1-7c46e8eb88b5 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:26.658436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0b008e67-6448-4725-8fb1-7c46e8eb88b5 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:26.658881 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0b008e67-6448-4725-8fb1-7c46e8eb88b5 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:26.659664 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0b008e67-6448-4725-8fb1-7c46e8eb88b5 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:26.660103 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0b008e67-6448-4725-8fb1-7c46e8eb88b5 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:26.795925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-0b008e67-6448-4725-8fb1-7c46e8eb88b5 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:04:26.802940 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0b008e67-6448-4725-8fb1-7c46e8eb88b5 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1561 microversion: 2.1 time: 0.156277 Jun 16 12:04:26.803503 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 529/1022] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:04:26 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:04:27.401587 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-993c6842-f42e-4733-ae6a-83b99941e2ba req-629d1b8e-980e-4d45-99a3-f4c2bb629a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8280b475-f6b8-4343-94ec-0e606c828d02", "tag": "6beb28f2-29cf-4f4d-9979-acede16177be"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:27.410809 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-993c6842-f42e-4733-ae6a-83b99941e2ba req-629d1b8e-980e-4d45-99a3-f4c2bb629a67 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:27.411296 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-993c6842-f42e-4733-ae6a-83b99941e2ba req-629d1b8e-980e-4d45-99a3-f4c2bb629a67 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:27.422949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-993c6842-f42e-4733-ae6a-83b99941e2ba req-629d1b8e-980e-4d45-99a3-f4c2bb629a67 service nova] Creating event network-changed:6beb28f2-29cf-4f4d-9979-acede16177be for instance 8280b475-f6b8-4343-94ec-0e606c828d02 on hv-cinder-84614 Jun 16 12:04:27.428235 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-993c6842-f42e-4733-ae6a-83b99941e2ba req-629d1b8e-980e-4d45-99a3-f4c2bb629a67 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030357 Jun 16 12:04:27.429046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 494/1023] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:04:55.286105 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ebe11575-c187-4ed4-8783-e06d43f32542 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:04:55.286675 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ebe11575-c187-4ed4-8783-e06d43f32542 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:55.288764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:55.289415 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=50 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:55.294333 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebe11575-c187-4ed4-8783-e06d43f32542 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:55.294774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebe11575-c187-4ed4-8783-e06d43f32542 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:55.295634 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebe11575-c187-4ed4-8783-e06d43f32542 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:55.296090 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ebe11575-c187-4ed4-8783-e06d43f32542 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:55.318601 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ebe11575-c187-4ed4-8783-e06d43f32542 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/ips" status: 200 len: 150 microversion: 2.1 time: 0.036550 Jun 16 12:04:55.319154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 530/1024] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 12:04:55 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:04:56.962930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=65 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:56.963681 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=52 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:56.968384 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4990f2f3-e45e-4eea-971b-14b14730efc4 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e6c737-f965-4acc-adc1-0887bda4bc23"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:04:56.969506 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-4990f2f3-e45e-4eea-971b-14b14730efc4 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:04:56.975990 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4990f2f3-e45e-4eea-971b-14b14730efc4 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:56.979589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4990f2f3-e45e-4eea-971b-14b14730efc4 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:56.979589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4990f2f3-e45e-4eea-971b-14b14730efc4 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:04:56.979589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-4990f2f3-e45e-4eea-971b-14b14730efc4 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:04:57.670839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4990f2f3-e45e-4eea-971b-14b14730efc4 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709545 Jun 16 12:04:57.671472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 495/1025] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:04:56 2022] POST /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:05.152626 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b42fccd5-ec09-4a89-9f1a-b1df027ee864 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: .version_select at 0x7f43344a0040>, body: {"keypair": {"name": "tempest-keypair-1891081185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9D8ac9I0EGTMU3r4VMsCmrt/zecT4j5wyrKq5ByNtepKLh41aMMXA0tNfB2yq2viNd+U4tuwIOySgJ8oG2at69Ulfyh1AfAovgE5uXHwOwU4guAMlbZ6ip0X0+5rsZfA=="}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:05:05.168101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-b42fccd5-ec09-4a89-9f1a-b1df027ee864 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:05:05.172536 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-b42fccd5-ec09-4a89-9f1a-b1df027ee864 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for user 61dcabaa88464ba2aee72c163414d327 and project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:05:05.255952 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b42fccd5-ec09-4a89-9f1a-b1df027ee864 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107408 Jun 16 12:05:05.256534 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 531/1026] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 12:05:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:07.383044 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:07.388153 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2035909233", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5da113f2-855d-427a-92da-a197315b7e34"}], "security_groups": [{"name": "tempest-securitygroup--644615424"}], "key_name": "tempest-keypair-1891081185", "user_data": "}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:05:07.495772 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] validate_networks() for [('5da113f2-855d-427a-92da-a197315b7e34', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:05:07.599669 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:07.854908 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:05:07.855322 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:05:07.856023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:05:07.856430 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:05:07.856833 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:05:07.869723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:07.870138 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:07.870920 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:07.871344 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:07.894671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:05:07.899116 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for user 61dcabaa88464ba2aee72c163414d327 and project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:05:07.910293 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:05:07.912850 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:05:08.006733 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-01b1c29e-9d47-4d1e-ab68-89f67e421a8e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.625703 Jun 16 12:05:08.007382 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 496/1027] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:05:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:05:08.018126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cf606496-5a59-4867-83fd-74b8a83f1804 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:08.018956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cf606496-5a59-4867-83fd-74b8a83f1804 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:08.073078 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-cf606496-5a59-4867-83fd-74b8a83f1804 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:08.081326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cf606496-5a59-4867-83fd-74b8a83f1804 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1242 microversion: 2.1 time: 0.067743 Jun 16 12:05:08.082789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 532/1028] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:08 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:09.097810 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-32f2dc90-7275-4211-a150-135db716c438 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:09.098413 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-32f2dc90-7275-4211-a150-135db716c438 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:09.105050 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32f2dc90-7275-4211-a150-135db716c438 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:09.105489 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32f2dc90-7275-4211-a150-135db716c438 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:09.106243 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32f2dc90-7275-4211-a150-135db716c438 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:09.106671 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-32f2dc90-7275-4211-a150-135db716c438 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:09.167480 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-32f2dc90-7275-4211-a150-135db716c438 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:09.175388 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-32f2dc90-7275-4211-a150-135db716c438 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1238 microversion: 2.1 time: 0.081933 Jun 16 12:05:09.175958 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 497/1029] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:09 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:10.192454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-781373f8-ec15-4e0c-9fd2-86a1b0a35839 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:10.193077 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-781373f8-ec15-4e0c-9fd2-86a1b0a35839 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:10.199607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-781373f8-ec15-4e0c-9fd2-86a1b0a35839 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:10.200094 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-781373f8-ec15-4e0c-9fd2-86a1b0a35839 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:10.200866 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-781373f8-ec15-4e0c-9fd2-86a1b0a35839 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:10.201304 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-781373f8-ec15-4e0c-9fd2-86a1b0a35839 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:10.264542 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-781373f8-ec15-4e0c-9fd2-86a1b0a35839 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:10.273636 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-781373f8-ec15-4e0c-9fd2-86a1b0a35839 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1300 microversion: 2.1 time: 0.084957 Jun 16 12:05:10.281272 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 533/1030] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:10 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:05:11.291410 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0a346002-0363-443e-995b-ebef72deb8d0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:11.292183 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0a346002-0363-443e-995b-ebef72deb8d0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:11.301378 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a346002-0363-443e-995b-ebef72deb8d0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:11.301968 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a346002-0363-443e-995b-ebef72deb8d0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:11.302752 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a346002-0363-443e-995b-ebef72deb8d0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:11.303189 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a346002-0363-443e-995b-ebef72deb8d0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:11.524908 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0a346002-0363-443e-995b-ebef72deb8d0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:11.534023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0a346002-0363-443e-995b-ebef72deb8d0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1367 microversion: 2.1 time: 0.247117 Jun 16 12:05:11.536238 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 498/1031] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:11 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:12.022197 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-f94dffc3-ee15-442d-a771-2afcdd2357d3 req-b4fe8c7a-90e4-4d24-84ac-713bef8fe84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e76b78-579a-4611-aba5-f4547af3d874", "tag": "a298cc8b-658d-4c70-935c-7b3847dbcde9"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:05:12.031431 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-f94dffc3-ee15-442d-a771-2afcdd2357d3 req-b4fe8c7a-90e4-4d24-84ac-713bef8fe84d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:12.031887 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-f94dffc3-ee15-442d-a771-2afcdd2357d3 req-b4fe8c7a-90e4-4d24-84ac-713bef8fe84d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:12.045554 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-f94dffc3-ee15-442d-a771-2afcdd2357d3 req-b4fe8c7a-90e4-4d24-84ac-713bef8fe84d service nova] Creating event network-changed:a298cc8b-658d-4c70-935c-7b3847dbcde9 for instance 41e76b78-579a-4611-aba5-f4547af3d874 on hv-cinder-84614 Jun 16 12:05:12.052302 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-f94dffc3-ee15-442d-a771-2afcdd2357d3 req-b4fe8c7a-90e4-4d24-84ac-713bef8fe84d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033590 Jun 16 12:05:12.052904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 534/1032] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:12.551190 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-dd77e905-c382-4dc0-a7a0-a0946e57aa0c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:12.552046 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-dd77e905-c382-4dc0-a7a0-a0946e57aa0c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:12.559136 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dd77e905-c382-4dc0-a7a0-a0946e57aa0c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:12.559685 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dd77e905-c382-4dc0-a7a0-a0946e57aa0c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:12.560560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dd77e905-c382-4dc0-a7a0-a0946e57aa0c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:12.561069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-dd77e905-c382-4dc0-a7a0-a0946e57aa0c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:12.777757 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-dd77e905-c382-4dc0-a7a0-a0946e57aa0c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:12.785611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-dd77e905-c382-4dc0-a7a0-a0946e57aa0c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1367 microversion: 2.1 time: 0.238438 Jun 16 12:05:12.786187 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 499/1033] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:12 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:13.803112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-a6a653aa-5a3b-4f44-b1f7-4e8c91e9875d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:13.803815 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-a6a653aa-5a3b-4f44-b1f7-4e8c91e9875d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:13.810189 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6a653aa-5a3b-4f44-b1f7-4e8c91e9875d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:13.810638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6a653aa-5a3b-4f44-b1f7-4e8c91e9875d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:13.811401 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6a653aa-5a3b-4f44-b1f7-4e8c91e9875d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:13.812407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-a6a653aa-5a3b-4f44-b1f7-4e8c91e9875d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:13.941050 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-a6a653aa-5a3b-4f44-b1f7-4e8c91e9875d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:13.948533 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a6a653aa-5a3b-4f44-b1f7-4e8c91e9875d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1367 microversion: 2.1 time: 0.150084 Jun 16 12:05:13.949096 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 535/1034] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:13 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:14.964757 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c002635a-8c4f-4359-b2f8-3d05bfeeaeeb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:14.965364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c002635a-8c4f-4359-b2f8-3d05bfeeaeeb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:14.971919 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c002635a-8c4f-4359-b2f8-3d05bfeeaeeb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:14.972364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c002635a-8c4f-4359-b2f8-3d05bfeeaeeb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:14.973117 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c002635a-8c4f-4359-b2f8-3d05bfeeaeeb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:14.973550 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c002635a-8c4f-4359-b2f8-3d05bfeeaeeb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:15.101210 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c002635a-8c4f-4359-b2f8-3d05bfeeaeeb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:15.108527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c002635a-8c4f-4359-b2f8-3d05bfeeaeeb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1367 microversion: 2.1 time: 0.147641 Jun 16 12:05:15.109095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 500/1035] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:14 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:05:16.125726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6bdd64b5-060c-4ae3-9ce2-21a491890f58 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:16.126337 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6bdd64b5-060c-4ae3-9ce2-21a491890f58 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:16.133027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6bdd64b5-060c-4ae3-9ce2-21a491890f58 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:16.133544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6bdd64b5-060c-4ae3-9ce2-21a491890f58 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:16.134306 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6bdd64b5-060c-4ae3-9ce2-21a491890f58 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:16.134739 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6bdd64b5-060c-4ae3-9ce2-21a491890f58 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:16.261977 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6bdd64b5-060c-4ae3-9ce2-21a491890f58 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:16.269385 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6bdd64b5-060c-4ae3-9ce2-21a491890f58 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1367 microversion: 2.1 time: 0.148316 Jun 16 12:05:16.269964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 536/1036] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:16 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:16.865804 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-70376359-d4c5-4191-91de-189e90ac9bae req-daca3eff-d83c-43a0-ba5c-d54bb23328b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e76b78-579a-4611-aba5-f4547af3d874", "name": "network-vif-plugged", "status": "completed", "tag": "a298cc8b-658d-4c70-935c-7b3847dbcde9"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:05:16.874937 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-70376359-d4c5-4191-91de-189e90ac9bae req-daca3eff-d83c-43a0-ba5c-d54bb23328b1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:16.875360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-70376359-d4c5-4191-91de-189e90ac9bae req-daca3eff-d83c-43a0-ba5c-d54bb23328b1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:16.886532 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-70376359-d4c5-4191-91de-189e90ac9bae req-daca3eff-d83c-43a0-ba5c-d54bb23328b1 service nova] Creating event network-vif-plugged:a298cc8b-658d-4c70-935c-7b3847dbcde9 for instance 41e76b78-579a-4611-aba5-f4547af3d874 on hv-cinder-84614 Jun 16 12:05:16.891949 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-70376359-d4c5-4191-91de-189e90ac9bae req-daca3eff-d83c-43a0-ba5c-d54bb23328b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029835 Jun 16 12:05:16.892510 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 501/1037] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:17.286178 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b295476e-f856-4e2a-82d0-18aaa98fd3a1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:17.286783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-b295476e-f856-4e2a-82d0-18aaa98fd3a1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:17.293498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b295476e-f856-4e2a-82d0-18aaa98fd3a1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:17.293936 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b295476e-f856-4e2a-82d0-18aaa98fd3a1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:17.294698 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b295476e-f856-4e2a-82d0-18aaa98fd3a1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:17.295126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-b295476e-f856-4e2a-82d0-18aaa98fd3a1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:17.428026 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-b295476e-f856-4e2a-82d0-18aaa98fd3a1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:17.435385 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b295476e-f856-4e2a-82d0-18aaa98fd3a1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1367 microversion: 2.1 time: 0.153141 Jun 16 12:05:17.435960 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 537/1038] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:17 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:18.450586 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:18.451764 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=6 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:18.456338 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8ec4bacf-3271-43b4-b5f1-5113f134505f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:18.457054 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8ec4bacf-3271-43b4-b5f1-5113f134505f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:18.463769 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8ec4bacf-3271-43b4-b5f1-5113f134505f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:18.463769 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8ec4bacf-3271-43b4-b5f1-5113f134505f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:18.464488 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8ec4bacf-3271-43b4-b5f1-5113f134505f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:18.464921 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8ec4bacf-3271-43b4-b5f1-5113f134505f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:18.595717 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8ec4bacf-3271-43b4-b5f1-5113f134505f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:18.603629 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8ec4bacf-3271-43b4-b5f1-5113f134505f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1367 microversion: 2.1 time: 0.154501 Jun 16 12:05:18.604226 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 502/1039] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:18 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:19.621003 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ad05259b-a139-42d4-8840-02968b91dac0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:19.621605 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ad05259b-a139-42d4-8840-02968b91dac0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:19.623705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=6 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:19.629097 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad05259b-a139-42d4-8840-02968b91dac0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:19.629543 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad05259b-a139-42d4-8840-02968b91dac0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:19.630392 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad05259b-a139-42d4-8840-02968b91dac0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:19.630826 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ad05259b-a139-42d4-8840-02968b91dac0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:19.759339 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-ad05259b-a139-42d4-8840-02968b91dac0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:19.766735 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ad05259b-a139-42d4-8840-02968b91dac0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1556 microversion: 2.1 time: 0.149747 Jun 16 12:05:19.767292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 538/1040] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:19 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:19.782651 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-37ca2400-9df6-4a12-aaa0-90b0530080d6 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:19.783155 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-37ca2400-9df6-4a12-aaa0-90b0530080d6 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:19.789589 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-37ca2400-9df6-4a12-aaa0-90b0530080d6 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:19.790030 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-37ca2400-9df6-4a12-aaa0-90b0530080d6 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:19.790783 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-37ca2400-9df6-4a12-aaa0-90b0530080d6 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:19.791213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-37ca2400-9df6-4a12-aaa0-90b0530080d6 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:19.868333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-37ca2400-9df6-4a12-aaa0-90b0530080d6 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089518 Jun 16 12:05:19.868950 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 503/1041] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 12:05:19 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:20.787736 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-3e1a055d-d6b5-4bef-82ae-f16132c60f22 req-bd970efe-20de-49c9-b2aa-4579bcc0b981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e76b78-579a-4611-aba5-f4547af3d874", "tag": "a298cc8b-658d-4c70-935c-7b3847dbcde9"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:05:20.796384 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-3e1a055d-d6b5-4bef-82ae-f16132c60f22 req-bd970efe-20de-49c9-b2aa-4579bcc0b981 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:20.796899 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-3e1a055d-d6b5-4bef-82ae-f16132c60f22 req-bd970efe-20de-49c9-b2aa-4579bcc0b981 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:20.808181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-3e1a055d-d6b5-4bef-82ae-f16132c60f22 req-bd970efe-20de-49c9-b2aa-4579bcc0b981 service nova] Creating event network-changed:a298cc8b-658d-4c70-935c-7b3847dbcde9 for instance 41e76b78-579a-4611-aba5-f4547af3d874 on hv-cinder-84614 Jun 16 12:05:20.813638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-3e1a055d-d6b5-4bef-82ae-f16132c60f22 req-bd970efe-20de-49c9-b2aa-4579bcc0b981 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029506 Jun 16 12:05:20.814414 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 539/1042] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:45.055054 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:45.055798 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=38 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:45.059624 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cd067083-cd76-4368-9e84-e844966bcd77 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:45.062561 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:45.063294 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=38 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:45.067162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-aa70f53f-0eb0-47f7-b54f-d169fe7d3d2e req-b228b1f8-f9fe-4f58-a5a4-fb84b343d174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b481fc54-9d0a-4ce3-a4f8-651a22d1d276", "tag": "7856f81f-be70-45db-80ed-79a45bca3b14"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:05:45.069333 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-cd067083-cd76-4368-9e84-e844966bcd77 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:45.075312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-aa70f53f-0eb0-47f7-b54f-d169fe7d3d2e req-b228b1f8-f9fe-4f58-a5a4-fb84b343d174 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:45.075739 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cd067083-cd76-4368-9e84-e844966bcd77 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:45.075860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-aa70f53f-0eb0-47f7-b54f-d169fe7d3d2e req-b228b1f8-f9fe-4f58-a5a4-fb84b343d174 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:45.076236 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cd067083-cd76-4368-9e84-e844966bcd77 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:45.076988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cd067083-cd76-4368-9e84-e844966bcd77 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:45.077417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-cd067083-cd76-4368-9e84-e844966bcd77 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:45.087312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-aa70f53f-0eb0-47f7-b54f-d169fe7d3d2e req-b228b1f8-f9fe-4f58-a5a4-fb84b343d174 service nova] Creating event network-changed:7856f81f-be70-45db-80ed-79a45bca3b14 for instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 on hv-cinder-84614 Jun 16 12:05:45.092366 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-aa70f53f-0eb0-47f7-b54f-d169fe7d3d2e req-b228b1f8-f9fe-4f58-a5a4-fb84b343d174 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031110 Jun 16 12:05:45.096604 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 540/1043] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:45.107136 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-cd067083-cd76-4368-9e84-e844966bcd77 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Going to try to terminate instance {{(pid=125055) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:05:45.415080 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-cd067083-cd76-4368-9e84-e844966bcd77 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 204 len: 0 microversion: 2.1 time: 0.361109 Jun 16 12:05:45.418892 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 504/1044] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:05:45 2022] DELETE /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:05:45.425186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-09f5b000-95cb-420c-bd5f-02807b484836 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:45.425869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-09f5b000-95cb-420c-bd5f-02807b484836 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:45.433181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09f5b000-95cb-420c-bd5f-02807b484836 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:45.433627 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09f5b000-95cb-420c-bd5f-02807b484836 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:45.434469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09f5b000-95cb-420c-bd5f-02807b484836 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:45.434908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-09f5b000-95cb-420c-bd5f-02807b484836 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:45.570034 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-09f5b000-95cb-420c-bd5f-02807b484836 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:45.577783 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-09f5b000-95cb-420c-bd5f-02807b484836 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.157315 Jun 16 12:05:45.578388 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 541/1045] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:45 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:46.598751 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-293437fe-9e82-499b-91df-2d5396f26d69 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:46.599690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-293437fe-9e82-499b-91df-2d5396f26d69 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:46.606623 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-293437fe-9e82-499b-91df-2d5396f26d69 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:46.607060 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-293437fe-9e82-499b-91df-2d5396f26d69 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:46.607828 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-293437fe-9e82-499b-91df-2d5396f26d69 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:46.608278 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-293437fe-9e82-499b-91df-2d5396f26d69 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:46.878073 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-293437fe-9e82-499b-91df-2d5396f26d69 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:46.885454 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-293437fe-9e82-499b-91df-2d5396f26d69 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1567 microversion: 2.1 time: 0.291679 Jun 16 12:05:46.886013 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 505/1046] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:46 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:47.536131 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-7e443317-fe7e-4b27-9fdc-72c5497db1b4 req-c665b48c-21f9-434e-8fb1-65555fca81e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b481fc54-9d0a-4ce3-a4f8-651a22d1d276", "name": "network-vif-deleted", "tag": "7856f81f-be70-45db-80ed-79a45bca3b14"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:05:47.549914 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-7e443317-fe7e-4b27-9fdc-72c5497db1b4 req-c665b48c-21f9-434e-8fb1-65555fca81e1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:47.549914 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-7e443317-fe7e-4b27-9fdc-72c5497db1b4 req-c665b48c-21f9-434e-8fb1-65555fca81e1 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:47.555830 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-7e443317-fe7e-4b27-9fdc-72c5497db1b4 req-c665b48c-21f9-434e-8fb1-65555fca81e1 service nova] Creating event network-vif-deleted:7856f81f-be70-45db-80ed-79a45bca3b14 for instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 on hv-cinder-84614 Jun 16 12:05:47.560582 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-7e443317-fe7e-4b27-9fdc-72c5497db1b4 req-c665b48c-21f9-434e-8fb1-65555fca81e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029073 Jun 16 12:05:47.561249 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 542/1047] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:47.902655 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0a108e14-3cc5-4f03-aa80-99750abca13c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:47.903403 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0a108e14-3cc5-4f03-aa80-99750abca13c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:47.910137 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a108e14-3cc5-4f03-aa80-99750abca13c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:47.910575 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a108e14-3cc5-4f03-aa80-99750abca13c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:47.911339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a108e14-3cc5-4f03-aa80-99750abca13c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:47.911797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a108e14-3cc5-4f03-aa80-99750abca13c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:47.979028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0a108e14-3cc5-4f03-aa80-99750abca13c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81df1b996f4e6a808c83f4eebe586f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab61ecc47674e6e961f67c0b412fda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:47.986707 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0a108e14-3cc5-4f03-aa80-99750abca13c tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 200 len: 1219 microversion: 2.1 time: 0.088002 Jun 16 12:05:47.987268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 506/1048] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:47 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:49.003683 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:49.004326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [instance: b481fc54-9d0a-4ce3-a4f8-651a22d1d276] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:49.010551 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:49.010998 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:49.011754 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:49.012216 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:49.025623 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] HTTP exception thrown: Instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 could not be found. Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Request method failure captured: Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 HTTP/1.1 Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxtfrGFMHO1FZirH9Hj6Ql8PepOqDGAWUI55BeCbNMw2WKdki6b6PHDZwtBOiJE-xTpk7hb26TdEd5XyzQv9KBGSRy_KtHqbaVl7Va3PdRF-Umbf-A4-ZXqqmD-8hYhb59lrcEpFIExcoRadi4D2eBkikfEG61C8kpEhbEenmHOajMM Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: fab61ecc47674e6e961f67c0b412fda6 Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-TestShelveInstance-659177525 Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:05:49.027258 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fab61ecc47674e6e961f67c0b412fda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fab61ecc47674e6e961f67c0b412fda6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fab61ecc47674e6e961f67c0b412fda6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fab61ecc47674e6e961f67c0b412fda6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-TestShelveInstance-659177525 Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: fab61ecc47674e6e961f67c0b412fda6 Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-TestShelveInstance-659177525 Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-TestShelveInstance-659177525-project Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 6f81df1b996f4e6a808c83f4eebe586f Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-TestShelveInstance-659177525-project Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 could not be found. Jun 16 12:05:49.028958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'b481fc54-9d0a-4ce3-a4f8-651a22d1d276'} Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 could not be found. Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:05:49.029997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 could not be found. Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 could not be found. Jun 16 12:05:49.031319 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:05:49.032667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Returning 404 to user: Instance b481fc54-9d0a-4ce3-a4f8-651a22d1d276 could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:05:49.032667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-0688fe0d-510e-4c8f-a2f3-1b82f1c801ae tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276" status: 404 len: 111 microversion: 2.1 time: 0.029791 Jun 16 12:05:49.032667 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 543/1049] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:48 2022] GET /compute/v2.1/servers/b481fc54-9d0a-4ce3-a4f8-651a22d1d276 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:05:49.271317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d7df80e8-4a16-4be0-8112-81a5d37b3ff0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] Calling method '.version_select at 0x7f4334302550>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:49.274497 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d7df80e8-4a16-4be0-8112-81a5d37b3ff0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [1e1c02c4-595b-4f6d-b6e8-27595bc781c8] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 12:05:50.282568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO oslo.messaging._drivers.impl_rabbit [None req-d7df80e8-4a16-4be0-8112-81a5d37b3ff0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] [1e1c02c4-595b-4f6d-b6e8-27595bc781c8] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36606. Jun 16 12:05:50.363905 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d7df80e8-4a16-4be0-8112-81a5d37b3ff0 tempest-TestShelveInstance-659177525 tempest-TestShelveInstance-659177525-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1800397449" status: 202 len: 0 microversion: 2.1 time: 1.097018 Jun 16 12:05:50.364519 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 507/1050] 10.222.0.40 () {58 vars in 1253 bytes} [Thu Jun 16 12:05:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1800397449 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:05:55.016688 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c495e520-e03c-4e69-b5f2-13faab858b39 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:55.017829 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c495e520-e03c-4e69-b5f2-13faab858b39 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:55.024693 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c495e520-e03c-4e69-b5f2-13faab858b39 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:55.025158 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c495e520-e03c-4e69-b5f2-13faab858b39 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:55.025931 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c495e520-e03c-4e69-b5f2-13faab858b39 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:55.026363 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c495e520-e03c-4e69-b5f2-13faab858b39 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:55.051305 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c495e520-e03c-4e69-b5f2-13faab858b39 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874/ips" status: 200 len: 149 microversion: 2.1 time: 0.038492 Jun 16 12:05:55.052334 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 544/1051] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 12:05:55 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:05:55.063281 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e6c737-f965-4acc-adc1-0887bda4bc23"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:05:55.065036 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:55.071548 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:55.072028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:55.072815 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:55.073236 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:55.157023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Invalid volume: volume e9e6c737-f965-4acc-adc1-0887bda4bc23 is already attached to instances: 4221add6-1a15-44e5-b48a-6a62e0a302ef Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: POST /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874/os-volume_attachments HTTP/1.1 Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 74 Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:05:55.159481 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {"volumeAttachment": {"volumeId": "e9e6c737-f965-4acc-adc1-0887bda4bc23"}} Jun 16 12:05:55.161199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Invalid volume: volume e9e6c737-f965-4acc-adc1-0887bda4bc23 is already attached to instances: 4221add6-1a15-44e5-b48a-6a62e0a302ef Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'server_id': '41e76b78-579a-4611-aba5-f4547af3d874', 'body': {'volumeAttachment': {'volumeId': 'e9e6c737-f965-4acc-adc1-0887bda4bc23'}}} Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e9e6c737-f965-4acc-adc1-0887bda4bc23 is already attached to instances: 4221add6-1a15-44e5-b48a-6a62e0a302ef Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:05:55.162166 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e9e6c737-f965-4acc-adc1-0887bda4bc23 is already attached to instances: 4221add6-1a15-44e5-b48a-6a62e0a302ef Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:05:55.163700 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:05:55.165256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:05:55.165256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:05:55.165256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:05:55.165256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e9e6c737-f965-4acc-adc1-0887bda4bc23 is already attached to instances: 4221add6-1a15-44e5-b48a-6a62e0a302ef Jun 16 12:05:55.165256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:05:55.165256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 400 to user: Invalid volume: volume e9e6c737-f965-4acc-adc1-0887bda4bc23 is already attached to instances: 4221add6-1a15-44e5-b48a-6a62e0a302ef {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:05:55.165256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0a7ea952-ef66-4a0d-9e8c-73eaa5846811 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102530 Jun 16 12:05:55.165256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 508/1052] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:05:55 2022] POST /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:05:55.170383 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9189c00f-140d-4b5d-8aa4-39d2aa0290f0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:55.170894 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9189c00f-140d-4b5d-8aa4-39d2aa0290f0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:55.177577 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9189c00f-140d-4b5d-8aa4-39d2aa0290f0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:55.178022 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9189c00f-140d-4b5d-8aa4-39d2aa0290f0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:55.178792 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9189c00f-140d-4b5d-8aa4-39d2aa0290f0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:55.179224 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9189c00f-140d-4b5d-8aa4-39d2aa0290f0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:55.205525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9189c00f-140d-4b5d-8aa4-39d2aa0290f0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:05:55.426257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9189c00f-140d-4b5d-8aa4-39d2aa0290f0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 204 len: 0 microversion: 2.1 time: 0.260017 Jun 16 12:05:55.426839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 545/1053] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:05:55 2022] DELETE /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:05:55.436317 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a1aa44cc-d720-47d1-9f09-50f64c21b456 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:55.437168 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a1aa44cc-d720-47d1-9f09-50f64c21b456 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:55.444225 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a1aa44cc-d720-47d1-9f09-50f64c21b456 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:55.444878 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a1aa44cc-d720-47d1-9f09-50f64c21b456 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:55.445959 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a1aa44cc-d720-47d1-9f09-50f64c21b456 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:55.446385 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a1aa44cc-d720-47d1-9f09-50f64c21b456 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:55.678754 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a1aa44cc-d720-47d1-9f09-50f64c21b456 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:55.691760 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a1aa44cc-d720-47d1-9f09-50f64c21b456 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1681 microversion: 2.1 time: 0.260453 Jun 16 12:05:55.692379 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 509/1054] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:55 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:56.711435 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f359a12b-28c7-42ba-ae44-9ec43f79c31d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:56.712880 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f359a12b-28c7-42ba-ae44-9ec43f79c31d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:56.723539 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f359a12b-28c7-42ba-ae44-9ec43f79c31d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:56.725074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f359a12b-28c7-42ba-ae44-9ec43f79c31d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:56.728329 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f359a12b-28c7-42ba-ae44-9ec43f79c31d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:56.742419 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f359a12b-28c7-42ba-ae44-9ec43f79c31d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:56.909638 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f359a12b-28c7-42ba-ae44-9ec43f79c31d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:56.917466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f359a12b-28c7-42ba-ae44-9ec43f79c31d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1681 microversion: 2.1 time: 0.211133 Jun 16 12:05:56.918031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 546/1055] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:56 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:57.934521 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f2ebb3e6-d77d-4379-b701-204ae93edb4e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:57.935357 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f2ebb3e6-d77d-4379-b701-204ae93edb4e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:57.942646 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f2ebb3e6-d77d-4379-b701-204ae93edb4e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:57.943086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f2ebb3e6-d77d-4379-b701-204ae93edb4e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:57.943930 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f2ebb3e6-d77d-4379-b701-204ae93edb4e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:57.944539 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f2ebb3e6-d77d-4379-b701-204ae93edb4e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:58.288659 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f2ebb3e6-d77d-4379-b701-204ae93edb4e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:58.296069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f2ebb3e6-d77d-4379-b701-204ae93edb4e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1681 microversion: 2.1 time: 0.365472 Jun 16 12:05:58.296637 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 510/1056] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:57 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1681 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:05:59.313634 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-46c45673-850e-4e3a-97a3-50ca3db980de tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:05:59.314199 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-46c45673-850e-4e3a-97a3-50ca3db980de tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:05:59.320774 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46c45673-850e-4e3a-97a3-50ca3db980de tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:59.321222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46c45673-850e-4e3a-97a3-50ca3db980de tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:59.322048 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46c45673-850e-4e3a-97a3-50ca3db980de tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:05:59.322484 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-46c45673-850e-4e3a-97a3-50ca3db980de tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:05:59.654999 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-46c45673-850e-4e3a-97a3-50ca3db980de tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:05:59.663126 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-46c45673-850e-4e3a-97a3-50ca3db980de tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1681 microversion: 2.1 time: 0.353512 Jun 16 12:05:59.663987 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 547/1057] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:05:59 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:00.187100 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-87c9552d-c80d-4fa5-99b8-934f9d4aafb2 req-769169b2-54ae-4a46-ad24-cf91c44a3469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e76b78-579a-4611-aba5-f4547af3d874", "name": "network-vif-deleted", "tag": "a298cc8b-658d-4c70-935c-7b3847dbcde9"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:00.203256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-87c9552d-c80d-4fa5-99b8-934f9d4aafb2 req-769169b2-54ae-4a46-ad24-cf91c44a3469 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:00.203256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-87c9552d-c80d-4fa5-99b8-934f9d4aafb2 req-769169b2-54ae-4a46-ad24-cf91c44a3469 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:00.208132 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-87c9552d-c80d-4fa5-99b8-934f9d4aafb2 req-769169b2-54ae-4a46-ad24-cf91c44a3469 service nova] Creating event network-vif-deleted:a298cc8b-658d-4c70-935c-7b3847dbcde9 for instance 41e76b78-579a-4611-aba5-f4547af3d874 on hv-cinder-84614 Jun 16 12:06:00.214352 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-87c9552d-c80d-4fa5-99b8-934f9d4aafb2 req-769169b2-54ae-4a46-ad24-cf91c44a3469 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030746 Jun 16 12:06:00.215150 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 511/1058] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:00.683113 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:00.683791 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:00.691222 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:00.691769 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:00.692859 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:00.693389 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:00.725423 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:00.726032 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:00.726582 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lazy-loading 'fault' on Instance uuid 41e76b78-579a-4611-aba5-f4547af3d874 {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:06:00.772277 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:00.780315 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-564b9d3a-08fc-4163-b681-aeef9a005dba tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 200 len: 1332 microversion: 2.1 time: 0.103451 Jun 16 12:06:00.790743 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 548/1059] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:00 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:01.800052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:01.800743 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:01.806941 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:01.807384 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:01.808177 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:01.808606 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:01.822260 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 HTTP/1.1 Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:06:01.823843 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:06:01.825466 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '41e76b78-579a-4611-aba5-f4547af3d874'} Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:06:01.826387 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:06:01.828028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:01.829423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:06:01.829423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a929fa9b-cf03-494d-9864-eee35659f62e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 404 len: 111 microversion: 2.1 time: 0.030441 Jun 16 12:06:01.829423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 512/1060] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:01 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:06:01.834001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-85bd7de0-4dd4-4b11-9574-beec61616e26 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '.version_select at 0x7f43344c1c10>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:01.912938 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-85bd7de0-4dd4-4b11-9574-beec61616e26 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891081185" status: 202 len: 0 microversion: 2.1 time: 0.082596 Jun 16 12:06:01.913506 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 549/1061] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 12:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891081185 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:06:02.680012 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-aa195ba8-5871-4ce9-936e-daccf1eecf00 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:02.680592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-aa195ba8-5871-4ce9-936e-daccf1eecf00 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:02.686814 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa195ba8-5871-4ce9-936e-daccf1eecf00 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:02.687261 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa195ba8-5871-4ce9-936e-daccf1eecf00 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:02.688061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa195ba8-5871-4ce9-936e-daccf1eecf00 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:02.688517 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aa195ba8-5871-4ce9-936e-daccf1eecf00 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:02.767992 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-aa195ba8-5871-4ce9-936e-daccf1eecf00 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lazy-loading 'services' on Instance uuid 4221add6-1a15-44e5-b48a-6a62e0a302ef {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:06:02.957043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-aa195ba8-5871-4ce9-936e-daccf1eecf00 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-volume_attachments/e9e6c737-f965-4acc-adc1-0887bda4bc23" status: 202 len: 0 microversion: 2.1 time: 0.280944 Jun 16 12:06:02.957704 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 513/1062] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:06:02 2022] DELETE /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-volume_attachments/e9e6c737-f965-4acc-adc1-0887bda4bc23 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:06:02.966731 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-55be7f22-a352-44a7-91eb-29e89714af59 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:02.968426 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-55be7f22-a352-44a7-91eb-29e89714af59 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:02.976269 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-55be7f22-a352-44a7-91eb-29e89714af59 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:02.976735 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-55be7f22-a352-44a7-91eb-29e89714af59 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:02.977513 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-55be7f22-a352-44a7-91eb-29e89714af59 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:02.977974 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-55be7f22-a352-44a7-91eb-29e89714af59 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:03.008320 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-55be7f22-a352-44a7-91eb-29e89714af59 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046080 Jun 16 12:06:03.008907 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 550/1063] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:06:02 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:04.021447 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d0e808ae-6bae-4dff-878a-c006264a5726 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:04.027382 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d0e808ae-6bae-4dff-878a-c006264a5726 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:04.028745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d0e808ae-6bae-4dff-878a-c006264a5726 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:04.029301 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d0e808ae-6bae-4dff-878a-c006264a5726 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:04.030071 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d0e808ae-6bae-4dff-878a-c006264a5726 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:04.030509 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d0e808ae-6bae-4dff-878a-c006264a5726 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:04.061218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d0e808ae-6bae-4dff-878a-c006264a5726 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045323 Jun 16 12:06:04.061961 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 514/1064] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:06:04 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:06:04.119474 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4a0b1744-47ff-4bfd-b3f6-8b880100a72a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:04.120012 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4a0b1744-47ff-4bfd-b3f6-8b880100a72a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:04.126298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a0b1744-47ff-4bfd-b3f6-8b880100a72a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:04.126744 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a0b1744-47ff-4bfd-b3f6-8b880100a72a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:04.127504 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a0b1744-47ff-4bfd-b3f6-8b880100a72a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:04.127958 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4a0b1744-47ff-4bfd-b3f6-8b880100a72a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:04.138911 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1670911177", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1690805727", "security_groups": [{"name": "tempest-secgroup-smoke-1884746139"}], "block_device_mapping_v2": [{"uuid": "01ac2f29-42dc-4cb6-aa00-34bb8d304d3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a6f2fc51-0593-4393-8bad-bf4f67840cba"}]}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:04.153045 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4a0b1744-47ff-4bfd-b3f6-8b880100a72a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:06:04.254483 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.network.neutron [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] validate_networks() for [('a6f2fc51-0593-4393-8bad-bf4f67840cba', None, None, None, None, None)] {{(pid=125055) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:06:04.437153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4a0b1744-47ff-4bfd-b3f6-8b880100a72a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 204 len: 0 microversion: 2.1 time: 0.321118 Jun 16 12:06:04.437797 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 551/1065] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:06:04 2022] DELETE /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:06:04.446839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-dbd9ba47-25f6-488f-8d77-cf0c03b615f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:04.447718 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-dbd9ba47-25f6-488f-8d77-cf0c03b615f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:04.455360 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dbd9ba47-25f6-488f-8d77-cf0c03b615f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:04.455895 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dbd9ba47-25f6-488f-8d77-cf0c03b615f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:04.456779 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dbd9ba47-25f6-488f-8d77-cf0c03b615f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:04.457298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-dbd9ba47-25f6-488f-8d77-cf0c03b615f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:04.591172 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-dbd9ba47-25f6-488f-8d77-cf0c03b615f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:04.598947 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-dbd9ba47-25f6-488f-8d77-cf0c03b615f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1682 microversion: 2.1 time: 0.156255 Jun 16 12:06:04.599629 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 552/1066] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:04 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:06:04.619342 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Flavor limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:06:04.619757 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Image limits 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:06:04.620249 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Flavor pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:06:04.620647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Image pref 0:0:0 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:06:04.621047 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.virt.hardware [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:06:04.631115 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:04.631554 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:04.632371 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:04.632797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:04.649147 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Getting quotas for project 4be7fa7276cb42d3a8b6dd0dd12cd784. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:06:04.653043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Getting quotas for user f6e726651e4c49b794f5c86e1fe51d9c and project 4be7fa7276cb42d3a8b6dd0dd12cd784. Resources: {'ram', 'instances', 'cores'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:06:04.710611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Going to run 1 instances... {{(pid=125055) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:06:04.714251 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01ac2f29-42dc-4cb6-aa00-34bb8d304d3c',volume_size=None,volume_type=None)] {{(pid=125055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:06:05.089920 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-620cadd7-6759-4dac-b004-95ac64e5e544 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.954791 Jun 16 12:06:05.090828 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 515/1067] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:06:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:06:05.101280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9c87eb3a-6c42-4fa0-a735-391c1f5c1bc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:05.101908 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9c87eb3a-6c42-4fa0-a735-391c1f5c1bc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:05.158124 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9c87eb3a-6c42-4fa0-a735-391c1f5c1bc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:05.164617 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9c87eb3a-6c42-4fa0-a735-391c1f5c1bc4 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1095 microversion: 2.1 time: 0.067363 Jun 16 12:06:05.165175 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 553/1068] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:05 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:05.617011 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d8d66443-2be6-417e-9048-dd3e9b6cf209 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:05.617677 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d8d66443-2be6-417e-9048-dd3e9b6cf209 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:05.624420 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d8d66443-2be6-417e-9048-dd3e9b6cf209 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:05.624880 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d8d66443-2be6-417e-9048-dd3e9b6cf209 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:05.625643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d8d66443-2be6-417e-9048-dd3e9b6cf209 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:05.626078 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d8d66443-2be6-417e-9048-dd3e9b6cf209 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:05.757053 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-d8d66443-2be6-417e-9048-dd3e9b6cf209 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:05.764532 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d8d66443-2be6-417e-9048-dd3e9b6cf209 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1682 microversion: 2.1 time: 0.151414 Jun 16 12:06:05.765109 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 516/1069] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:05 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:06.182079 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-92efcc20-e933-47a5-b119-07c5788b7052 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:06.182695 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-92efcc20-e933-47a5-b119-07c5788b7052 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:06.192533 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92efcc20-e933-47a5-b119-07c5788b7052 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:06.192984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92efcc20-e933-47a5-b119-07c5788b7052 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:06.193976 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92efcc20-e933-47a5-b119-07c5788b7052 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:06.194412 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-92efcc20-e933-47a5-b119-07c5788b7052 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:06.263245 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-92efcc20-e933-47a5-b119-07c5788b7052 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:06.272900 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-92efcc20-e933-47a5-b119-07c5788b7052 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1137 microversion: 2.1 time: 0.094585 Jun 16 12:06:06.282326 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 554/1070] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:06 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1137 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:06.782346 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e4c99d33-4544-4454-af38-b14bd58f8362 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:06.783887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e4c99d33-4544-4454-af38-b14bd58f8362 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:06.791078 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4c99d33-4544-4454-af38-b14bd58f8362 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:06.794643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4c99d33-4544-4454-af38-b14bd58f8362 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:06.794643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4c99d33-4544-4454-af38-b14bd58f8362 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:06.794643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4c99d33-4544-4454-af38-b14bd58f8362 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:06.839412 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-364b5ee6-9faf-43b3-ba7d-f991c0cd0dcf req-d014bf54-bde2-4c1f-bd39-97e526ea4386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4221add6-1a15-44e5-b48a-6a62e0a302ef", "name": "network-vif-deleted", "tag": "167cae65-c8a1-4d89-8e20-2f8457a0736c"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:06.842446 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-364b5ee6-9faf-43b3-ba7d-f991c0cd0dcf req-d014bf54-bde2-4c1f-bd39-97e526ea4386 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:06.842988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-364b5ee6-9faf-43b3-ba7d-f991c0cd0dcf req-d014bf54-bde2-4c1f-bd39-97e526ea4386 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:06.857990 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-364b5ee6-9faf-43b3-ba7d-f991c0cd0dcf req-d014bf54-bde2-4c1f-bd39-97e526ea4386 service nova] Creating event network-vif-deleted:167cae65-c8a1-4d89-8e20-2f8457a0736c for instance 4221add6-1a15-44e5-b48a-6a62e0a302ef on hv-cinder-84614 Jun 16 12:06:06.869445 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-364b5ee6-9faf-43b3-ba7d-f991c0cd0dcf req-d014bf54-bde2-4c1f-bd39-97e526ea4386 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042597 Jun 16 12:06:06.887120 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e4c99d33-4544-4454-af38-b14bd58f8362 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:06.887120 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e4c99d33-4544-4454-af38-b14bd58f8362 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 200 len: 1615 microversion: 2.1 time: 0.104878 Jun 16 12:06:06.887466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 555/1071] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:06.894964 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 517/1072] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:06 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:07.291573 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2982ed58-4638-4257-a6c1-ebedea2a5bce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:07.292298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2982ed58-4638-4257-a6c1-ebedea2a5bce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:07.299382 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2982ed58-4638-4257-a6c1-ebedea2a5bce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:07.299828 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2982ed58-4638-4257-a6c1-ebedea2a5bce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:07.300629 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2982ed58-4638-4257-a6c1-ebedea2a5bce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:07.301059 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2982ed58-4638-4257-a6c1-ebedea2a5bce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:07.365814 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2982ed58-4638-4257-a6c1-ebedea2a5bce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:07.374628 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2982ed58-4638-4257-a6c1-ebedea2a5bce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1211 microversion: 2.1 time: 0.088690 Jun 16 12:06:07.375459 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 556/1073] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:07 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:07.908384 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:07.909351 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:07.922971 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:07.922971 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:07.922971 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:07.922971 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:07.962456 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef HTTP/1.1 Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:06:07.964182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:06:07.965871 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '4221add6-1a15-44e5-b48a-6a62e0a302ef'} Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:06:07.966774 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:06:07.968193 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:06:07.970020 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:06:07.970020 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ae6600e4-c7f5-43ae-8a45-d0e9fbd1dfa7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 404 len: 111 microversion: 2.1 time: 0.069058 Jun 16 12:06:07.970020 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 518/1074] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:07 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:06:07.974502 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-191ffa49-970e-4e3f-a795-65a6cc79ea82 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '.version_select at 0x7f4334420b80>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:08.027637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-191ffa49-970e-4e3f-a795-65a6cc79ea82 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195160341" status: 202 len: 0 microversion: 2.1 time: 0.056846 Jun 16 12:06:08.032283 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 557/1075] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 12:06:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195160341 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:06:08.392184 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-6726a566-7289-4159-a6c9-419a0e81e01e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:08.392857 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-6726a566-7289-4159-a6c9-419a0e81e01e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:08.399020 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6726a566-7289-4159-a6c9-419a0e81e01e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:08.399655 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6726a566-7289-4159-a6c9-419a0e81e01e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:08.400567 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6726a566-7289-4159-a6c9-419a0e81e01e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:08.401283 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-6726a566-7289-4159-a6c9-419a0e81e01e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:08.582951 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-6726a566-7289-4159-a6c9-419a0e81e01e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:08.591594 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-6726a566-7289-4159-a6c9-419a0e81e01e tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.203418 Jun 16 12:06:08.592216 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 519/1076] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:08 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:08.812860 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bc1c7a4c-79f9-41d7-9fb9-93a92546d25f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: .version_select at 0x7f43341f60d0>, body: {"keypair": {"name": "tempest-keypair-650218077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL01P1iiaKyA4E7QPoE6hnkO3OByAp7g6xYmG0QBRmL/vtPdyhsNm7KWuoWQYjkU+V2mT9QQNz8QEJtEChXinG9XWELV9+UYPk1xZviitwZlmnr2EmNAbeLux9X4sglOng=="}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:08.831408 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-bc1c7a4c-79f9-41d7-9fb9-93a92546d25f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:06:08.835193 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-bc1c7a4c-79f9-41d7-9fb9-93a92546d25f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for user 61dcabaa88464ba2aee72c163414d327 and project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'key_pairs'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:06:08.925067 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-5e157724-dcf7-42d1-9125-ff455e46c381 req-2f6b2c24-357b-4e7f-9843-667a73b61251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038951f4-f577-4c22-8896-817c1c290344", "tag": "f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:08.935389 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-5e157724-dcf7-42d1-9125-ff455e46c381 req-2f6b2c24-357b-4e7f-9843-667a73b61251 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:08.935940 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-5e157724-dcf7-42d1-9125-ff455e46c381 req-2f6b2c24-357b-4e7f-9843-667a73b61251 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:08.950590 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-5e157724-dcf7-42d1-9125-ff455e46c381 req-2f6b2c24-357b-4e7f-9843-667a73b61251 service nova] Creating event network-changed:f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73 for instance 038951f4-f577-4c22-8896-817c1c290344 on hv-cinder-84614 Jun 16 12:06:08.954594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bc1c7a4c-79f9-41d7-9fb9-93a92546d25f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143354 Jun 16 12:06:08.954594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 558/1077] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 12:06:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:08.956327 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-5e157724-dcf7-42d1-9125-ff455e46c381 req-2f6b2c24-357b-4e7f-9843-667a73b61251 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040058 Jun 16 12:06:08.957075 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 520/1078] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:06:09.609278 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-36a29e9a-a2cf-4ce9-9772-2475c1c1793c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:09.609892 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-36a29e9a-a2cf-4ce9-9772-2475c1c1793c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:09.615968 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-36a29e9a-a2cf-4ce9-9772-2475c1c1793c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:09.616424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-36a29e9a-a2cf-4ce9-9772-2475c1c1793c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:09.617281 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-36a29e9a-a2cf-4ce9-9772-2475c1c1793c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:09.617720 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-36a29e9a-a2cf-4ce9-9772-2475c1c1793c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:09.802510 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-36a29e9a-a2cf-4ce9-9772-2475c1c1793c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:09.806317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:09.810665 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-36a29e9a-a2cf-4ce9-9772-2475c1c1793c tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.205418 Jun 16 12:06:09.811225 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 559/1079] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:09 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:10.828615 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-095d8d84-d947-491e-b598-e7964675a038 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:10.829897 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-095d8d84-d947-491e-b598-e7964675a038 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:10.836662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-095d8d84-d947-491e-b598-e7964675a038 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:10.837181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-095d8d84-d947-491e-b598-e7964675a038 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:10.838207 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-095d8d84-d947-491e-b598-e7964675a038 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:10.838522 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-095d8d84-d947-491e-b598-e7964675a038 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:10.973179 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-095d8d84-d947-491e-b598-e7964675a038 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:10.982256 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-095d8d84-d947-491e-b598-e7964675a038 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.157976 Jun 16 12:06:10.982833 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 521/1080] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:10 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:11.019438 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1006349964", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5da113f2-855d-427a-92da-a197315b7e34"}], "security_groups": [{"name": "tempest-securitygroup--263375092"}], "key_name": "tempest-keypair-650218077", "user_data": "}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:11.120950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] validate_networks() for [('5da113f2-855d-427a-92da-a197315b7e34', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:06:11.487076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:06:11.487076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:06:11.487076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:06:11.487076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:06:11.487076 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:06:11.496190 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:11.496639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:11.497433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:11.497872 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:11.516448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:06:11.520503 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for user 61dcabaa88464ba2aee72c163414d327 and project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:06:11.531825 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:06:11.534097 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:06:11.685572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ab1c0cd8-a158-4fb7-a2cc-6b5d34203ec9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.671263 Jun 16 12:06:11.691266 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 560/1081] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:06:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:06:11.696271 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-12fd1130-b57b-48fd-ae20-2a996e62e3bc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:11.697654 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-12fd1130-b57b-48fd-ae20-2a996e62e3bc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:11.759472 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-12fd1130-b57b-48fd-ae20-2a996e62e3bc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:11.766356 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-12fd1130-b57b-48fd-ae20-2a996e62e3bc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1241 microversion: 2.1 time: 0.073853 Jun 16 12:06:11.767039 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 522/1082] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:11 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:11.998602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-88e78c59-f895-46c7-9ad5-8a1a9de54cf5 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:11.999144 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-88e78c59-f895-46c7-9ad5-8a1a9de54cf5 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:12.005238 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-88e78c59-f895-46c7-9ad5-8a1a9de54cf5 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:12.005686 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-88e78c59-f895-46c7-9ad5-8a1a9de54cf5 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:12.006456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-88e78c59-f895-46c7-9ad5-8a1a9de54cf5 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:12.006886 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-88e78c59-f895-46c7-9ad5-8a1a9de54cf5 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:12.139031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-88e78c59-f895-46c7-9ad5-8a1a9de54cf5 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:12.147164 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-88e78c59-f895-46c7-9ad5-8a1a9de54cf5 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.152600 Jun 16 12:06:12.147726 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 561/1083] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:11 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:12.783270 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-3e2808c9-0c51-45c0-b49a-68f6722bb53d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:12.784059 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-3e2808c9-0c51-45c0-b49a-68f6722bb53d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:12.790475 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e2808c9-0c51-45c0-b49a-68f6722bb53d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:12.790914 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e2808c9-0c51-45c0-b49a-68f6722bb53d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:12.791665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e2808c9-0c51-45c0-b49a-68f6722bb53d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:12.792134 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-3e2808c9-0c51-45c0-b49a-68f6722bb53d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:12.811224 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:12.858003 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-3e2808c9-0c51-45c0-b49a-68f6722bb53d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:12.865778 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-3e2808c9-0c51-45c0-b49a-68f6722bb53d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1245 microversion: 2.1 time: 0.086409 Jun 16 12:06:12.868314 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 523/1084] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:12 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:13.219370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-59e27000-9640-42b6-8e96-7f0b3a4235e2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:13.220620 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-59e27000-9640-42b6-8e96-7f0b3a4235e2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:13.226912 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-59e27000-9640-42b6-8e96-7f0b3a4235e2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:13.227347 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-59e27000-9640-42b6-8e96-7f0b3a4235e2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:13.228146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-59e27000-9640-42b6-8e96-7f0b3a4235e2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:13.228576 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-59e27000-9640-42b6-8e96-7f0b3a4235e2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:13.359304 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-59e27000-9640-42b6-8e96-7f0b3a4235e2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:13.367368 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-59e27000-9640-42b6-8e96-7f0b3a4235e2 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.206941 Jun 16 12:06:13.367942 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 562/1085] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:13 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:13.882818 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c902a278-5e1a-4c13-851a-a32d8a19f734 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:13.883415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c902a278-5e1a-4c13-851a-a32d8a19f734 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:13.890355 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c902a278-5e1a-4c13-851a-a32d8a19f734 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:13.892490 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c902a278-5e1a-4c13-851a-a32d8a19f734 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:13.892490 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c902a278-5e1a-4c13-851a-a32d8a19f734 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:13.892490 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c902a278-5e1a-4c13-851a-a32d8a19f734 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:13.970051 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c902a278-5e1a-4c13-851a-a32d8a19f734 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:13.977663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c902a278-5e1a-4c13-851a-a32d8a19f734 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1299 microversion: 2.1 time: 0.098963 Jun 16 12:06:13.978146 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 524/1086] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:13 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:14.384298 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6ac79ee0-29ce-4f26-8259-e24bb3632ddf tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:14.387112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6ac79ee0-29ce-4f26-8259-e24bb3632ddf tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:14.391502 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6ac79ee0-29ce-4f26-8259-e24bb3632ddf tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:14.391984 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6ac79ee0-29ce-4f26-8259-e24bb3632ddf tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:14.392761 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6ac79ee0-29ce-4f26-8259-e24bb3632ddf tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:14.393189 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6ac79ee0-29ce-4f26-8259-e24bb3632ddf tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:14.539476 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-6ac79ee0-29ce-4f26-8259-e24bb3632ddf tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:14.547174 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6ac79ee0-29ce-4f26-8259-e24bb3632ddf tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.166979 Jun 16 12:06:14.548585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 563/1087] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:14 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:15.000647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-bbd177a0-a020-46ec-b575-1ff2ef071146 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:15.001592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-bbd177a0-a020-46ec-b575-1ff2ef071146 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:15.005038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:15.010425 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bbd177a0-a020-46ec-b575-1ff2ef071146 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:15.010970 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bbd177a0-a020-46ec-b575-1ff2ef071146 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:15.011933 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bbd177a0-a020-46ec-b575-1ff2ef071146 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:15.012375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bbd177a0-a020-46ec-b575-1ff2ef071146 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:15.153346 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-bbd177a0-a020-46ec-b575-1ff2ef071146 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:15.161690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-bbd177a0-a020-46ec-b575-1ff2ef071146 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1366 microversion: 2.1 time: 0.165118 Jun 16 12:06:15.162273 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 525/1088] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:14 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:15.202594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-3c1214c3-76bc-409f-8ca8-01980f8281c8 req-d649ab5f-a1dc-4f1e-9394-b28e164d06ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64412494-6cf2-433f-903e-11ebf265d73b", "tag": "09787d46-aeff-414a-ab66-48787dd86c17"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:15.212026 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-3c1214c3-76bc-409f-8ca8-01980f8281c8 req-d649ab5f-a1dc-4f1e-9394-b28e164d06ff service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:15.212471 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-3c1214c3-76bc-409f-8ca8-01980f8281c8 req-d649ab5f-a1dc-4f1e-9394-b28e164d06ff service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:15.232846 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-3c1214c3-76bc-409f-8ca8-01980f8281c8 req-d649ab5f-a1dc-4f1e-9394-b28e164d06ff service nova] Creating event network-changed:09787d46-aeff-414a-ab66-48787dd86c17 for instance 64412494-6cf2-433f-903e-11ebf265d73b on hv-cinder-84614 Jun 16 12:06:15.237728 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-3c1214c3-76bc-409f-8ca8-01980f8281c8 req-d649ab5f-a1dc-4f1e-9394-b28e164d06ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039895 Jun 16 12:06:15.238324 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 564/1089] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:15.563337 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-273bcd56-9af8-4cc6-80a3-5a985be8fe22 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:15.564470 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-273bcd56-9af8-4cc6-80a3-5a985be8fe22 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:15.566323 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:15.571106 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-273bcd56-9af8-4cc6-80a3-5a985be8fe22 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:15.571550 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-273bcd56-9af8-4cc6-80a3-5a985be8fe22 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:15.572363 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-273bcd56-9af8-4cc6-80a3-5a985be8fe22 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:15.572777 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-273bcd56-9af8-4cc6-80a3-5a985be8fe22 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:15.796734 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-273bcd56-9af8-4cc6-80a3-5a985be8fe22 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:15.804827 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-273bcd56-9af8-4cc6-80a3-5a985be8fe22 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.245378 Jun 16 12:06:15.805391 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 526/1090] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:15 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:16.180093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-bd656ad6-5c0a-4344-b3b1-aed1dca5008a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:16.180813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-bd656ad6-5c0a-4344-b3b1-aed1dca5008a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:16.182706 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:16.187605 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd656ad6-5c0a-4344-b3b1-aed1dca5008a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:16.188074 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd656ad6-5c0a-4344-b3b1-aed1dca5008a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:16.188831 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd656ad6-5c0a-4344-b3b1-aed1dca5008a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:16.189254 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-bd656ad6-5c0a-4344-b3b1-aed1dca5008a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:16.316208 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-bd656ad6-5c0a-4344-b3b1-aed1dca5008a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:16.323896 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-bd656ad6-5c0a-4344-b3b1-aed1dca5008a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1366 microversion: 2.1 time: 0.148500 Jun 16 12:06:16.324451 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 565/1091] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:16 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:16.822392 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0338ddea-5d62-4391-b840-a20a38b3011f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:16.822931 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0338ddea-5d62-4391-b840-a20a38b3011f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:16.830121 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0338ddea-5d62-4391-b840-a20a38b3011f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:16.830563 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0338ddea-5d62-4391-b840-a20a38b3011f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:16.831352 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0338ddea-5d62-4391-b840-a20a38b3011f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:16.831795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0338ddea-5d62-4391-b840-a20a38b3011f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:16.962354 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0338ddea-5d62-4391-b840-a20a38b3011f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:16.969819 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0338ddea-5d62-4391-b840-a20a38b3011f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.151780 Jun 16 12:06:16.970374 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 527/1092] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:16 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:17.340403 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d3ac0123-af5f-4cb7-991a-4b4c63007cc9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:17.341030 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d3ac0123-af5f-4cb7-991a-4b4c63007cc9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:17.347724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d3ac0123-af5f-4cb7-991a-4b4c63007cc9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:17.348202 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d3ac0123-af5f-4cb7-991a-4b4c63007cc9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:17.348965 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d3ac0123-af5f-4cb7-991a-4b4c63007cc9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:17.349428 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d3ac0123-af5f-4cb7-991a-4b4c63007cc9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:17.480493 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d3ac0123-af5f-4cb7-991a-4b4c63007cc9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:17.488504 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d3ac0123-af5f-4cb7-991a-4b4c63007cc9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1366 microversion: 2.1 time: 0.152081 Jun 16 12:06:17.489400 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 566/1093] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:17 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:17.988113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-5caefcb3-f8ed-4d9f-91a6-265c2cd96328 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:17.988745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-5caefcb3-f8ed-4d9f-91a6-265c2cd96328 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:17.995156 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5caefcb3-f8ed-4d9f-91a6-265c2cd96328 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:17.995576 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5caefcb3-f8ed-4d9f-91a6-265c2cd96328 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:17.996350 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5caefcb3-f8ed-4d9f-91a6-265c2cd96328 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:17.996776 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-5caefcb3-f8ed-4d9f-91a6-265c2cd96328 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:18.125888 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-5caefcb3-f8ed-4d9f-91a6-265c2cd96328 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:18.133528 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-5caefcb3-f8ed-4d9f-91a6-265c2cd96328 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.150052 Jun 16 12:06:18.134081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 528/1094] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:17 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:18.505834 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7b606841-06ad-43df-b822-4b9399a3228d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:18.506443 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7b606841-06ad-43df-b822-4b9399a3228d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:18.512949 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b606841-06ad-43df-b822-4b9399a3228d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:18.513395 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b606841-06ad-43df-b822-4b9399a3228d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:18.514153 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b606841-06ad-43df-b822-4b9399a3228d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:18.514587 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b606841-06ad-43df-b822-4b9399a3228d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:18.638234 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-7b606841-06ad-43df-b822-4b9399a3228d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:18.646138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7b606841-06ad-43df-b822-4b9399a3228d tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1366 microversion: 2.1 time: 0.144170 Jun 16 12:06:18.646705 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 567/1095] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:18 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:19.150721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a7ff451d-a7d6-44d5-8b87-39e2b68246ce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:19.151564 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a7ff451d-a7d6-44d5-8b87-39e2b68246ce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:19.158707 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a7ff451d-a7d6-44d5-8b87-39e2b68246ce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:19.159360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a7ff451d-a7d6-44d5-8b87-39e2b68246ce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:19.160157 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a7ff451d-a7d6-44d5-8b87-39e2b68246ce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:19.160593 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a7ff451d-a7d6-44d5-8b87-39e2b68246ce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:19.291770 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a7ff451d-a7d6-44d5-8b87-39e2b68246ce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:19.300534 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a7ff451d-a7d6-44d5-8b87-39e2b68246ce tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.153692 Jun 16 12:06:19.301038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 529/1096] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:19 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:19.344301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-e27089e6-d356-433a-a7a8-109cb530d2e6 req-28559e3d-15eb-44f3-87e1-688667929bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038951f4-f577-4c22-8896-817c1c290344", "name": "network-vif-plugged", "status": "completed", "tag": "f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:19.353619 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-e27089e6-d356-433a-a7a8-109cb530d2e6 req-28559e3d-15eb-44f3-87e1-688667929bc8 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:19.354054 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-e27089e6-d356-433a-a7a8-109cb530d2e6 req-28559e3d-15eb-44f3-87e1-688667929bc8 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:19.365786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-e27089e6-d356-433a-a7a8-109cb530d2e6 req-28559e3d-15eb-44f3-87e1-688667929bc8 service nova] Creating event network-vif-plugged:f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73 for instance 038951f4-f577-4c22-8896-817c1c290344 on hv-cinder-84614 Jun 16 12:06:19.370673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-e27089e6-d356-433a-a7a8-109cb530d2e6 req-28559e3d-15eb-44f3-87e1-688667929bc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030039 Jun 16 12:06:19.371270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 568/1097] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:19.663139 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-fc8cec38-4e90-4dfa-b8f4-4c89714267f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:19.664067 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-fc8cec38-4e90-4dfa-b8f4-4c89714267f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:19.670161 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fc8cec38-4e90-4dfa-b8f4-4c89714267f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:19.670607 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fc8cec38-4e90-4dfa-b8f4-4c89714267f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:19.671366 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fc8cec38-4e90-4dfa-b8f4-4c89714267f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:19.672303 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-fc8cec38-4e90-4dfa-b8f4-4c89714267f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:19.807548 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-fc8cec38-4e90-4dfa-b8f4-4c89714267f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:19.815942 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-fc8cec38-4e90-4dfa-b8f4-4c89714267f7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1366 microversion: 2.1 time: 0.156589 Jun 16 12:06:19.816515 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 530/1098] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:19 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:20.318138 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2713ec46-a81b-4e86-99ff-551bc0e95991 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:20.318830 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2713ec46-a81b-4e86-99ff-551bc0e95991 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:20.325027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2713ec46-a81b-4e86-99ff-551bc0e95991 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:20.325474 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2713ec46-a81b-4e86-99ff-551bc0e95991 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:20.326228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2713ec46-a81b-4e86-99ff-551bc0e95991 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:20.326663 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2713ec46-a81b-4e86-99ff-551bc0e95991 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:20.459110 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-2713ec46-a81b-4e86-99ff-551bc0e95991 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:20.466495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2713ec46-a81b-4e86-99ff-551bc0e95991 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1267 microversion: 2.1 time: 0.153181 Jun 16 12:06:20.467057 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 569/1099] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:20 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:20.837493 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a1e96a76-1766-4e95-8157-498da036b90f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:20.838124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a1e96a76-1766-4e95-8157-498da036b90f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:20.845619 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a1e96a76-1766-4e95-8157-498da036b90f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:20.846178 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a1e96a76-1766-4e95-8157-498da036b90f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:20.848164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a1e96a76-1766-4e95-8157-498da036b90f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:20.848164 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a1e96a76-1766-4e95-8157-498da036b90f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:20.979457 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a1e96a76-1766-4e95-8157-498da036b90f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:20.987660 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a1e96a76-1766-4e95-8157-498da036b90f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1366 microversion: 2.1 time: 0.154025 Jun 16 12:06:20.991783 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 531/1100] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:20 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:21.384550 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-1c1abba6-f15e-425e-b960-95a34ea3f926 req-a9977d86-5d27-4a3d-8caa-90713581a848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64412494-6cf2-433f-903e-11ebf265d73b", "name": "network-vif-plugged", "status": "completed", "tag": "09787d46-aeff-414a-ab66-48787dd86c17"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:21.393402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-1c1abba6-f15e-425e-b960-95a34ea3f926 req-a9977d86-5d27-4a3d-8caa-90713581a848 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:21.393842 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-1c1abba6-f15e-425e-b960-95a34ea3f926 req-a9977d86-5d27-4a3d-8caa-90713581a848 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:21.404424 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-1c1abba6-f15e-425e-b960-95a34ea3f926 req-a9977d86-5d27-4a3d-8caa-90713581a848 service nova] Creating event network-vif-plugged:09787d46-aeff-414a-ab66-48787dd86c17 for instance 64412494-6cf2-433f-903e-11ebf265d73b on hv-cinder-84614 Jun 16 12:06:21.409781 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-1c1abba6-f15e-425e-b960-95a34ea3f926 req-a9977d86-5d27-4a3d-8caa-90713581a848 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028783 Jun 16 12:06:21.410332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 570/1101] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:21.483443 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-350e49f8-65de-4fa7-8ba7-67395af19dad tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:21.484083 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-350e49f8-65de-4fa7-8ba7-67395af19dad tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:21.490043 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-350e49f8-65de-4fa7-8ba7-67395af19dad tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:21.490474 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-350e49f8-65de-4fa7-8ba7-67395af19dad tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:21.491219 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-350e49f8-65de-4fa7-8ba7-67395af19dad tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:21.491646 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-350e49f8-65de-4fa7-8ba7-67395af19dad tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:21.620386 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-350e49f8-65de-4fa7-8ba7-67395af19dad tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:21.628880 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-350e49f8-65de-4fa7-8ba7-67395af19dad tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1455 microversion: 2.1 time: 0.149407 Jun 16 12:06:21.629442 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 532/1102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:21 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:06:21.642891 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:21.643643 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=12 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:21.647621 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-f1f40623-a8a2-4801-9dac-668d469cc462 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:21.648352 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-f1f40623-a8a2-4801-9dac-668d469cc462 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:21.654454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1f40623-a8a2-4801-9dac-668d469cc462 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:21.655343 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1f40623-a8a2-4801-9dac-668d469cc462 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:21.655730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1f40623-a8a2-4801-9dac-668d469cc462 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:21.656192 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-f1f40623-a8a2-4801-9dac-668d469cc462 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:21.789377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-f1f40623-a8a2-4801-9dac-668d469cc462 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:21.796875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-f1f40623-a8a2-4801-9dac-668d469cc462 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1455 microversion: 2.1 time: 0.155525 Jun 16 12:06:21.798307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 571/1103] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:21 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:06:22.005459 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0f5e5246-c416-490f-8d19-069148e3978c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:22.006070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0f5e5246-c416-490f-8d19-069148e3978c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:22.007934 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=8 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:22.013274 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0f5e5246-c416-490f-8d19-069148e3978c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:22.013738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0f5e5246-c416-490f-8d19-069148e3978c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:22.014593 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0f5e5246-c416-490f-8d19-069148e3978c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:22.015023 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0f5e5246-c416-490f-8d19-069148e3978c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:22.148332 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0f5e5246-c416-490f-8d19-069148e3978c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:22.155771 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0f5e5246-c416-490f-8d19-069148e3978c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1366 microversion: 2.1 time: 0.154851 Jun 16 12:06:22.156370 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 533/1104] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:21 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:23.174247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9531fd6f-fd59-4dd3-927b-c2d1fa498020 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:23.175355 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9531fd6f-fd59-4dd3-927b-c2d1fa498020 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:23.183095 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9531fd6f-fd59-4dd3-927b-c2d1fa498020 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:23.183758 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9531fd6f-fd59-4dd3-927b-c2d1fa498020 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:23.184614 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9531fd6f-fd59-4dd3-927b-c2d1fa498020 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:23.185053 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9531fd6f-fd59-4dd3-927b-c2d1fa498020 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:23.351322 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9531fd6f-fd59-4dd3-927b-c2d1fa498020 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:06:23.358897 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9531fd6f-fd59-4dd3-927b-c2d1fa498020 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1555 microversion: 2.1 time: 0.189320 Jun 16 12:06:23.359609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 572/1105] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:06:23 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:06:23.377069 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-b1fa242d-fa9a-45b6-8efb-7440f235a771 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:06:23.377586 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-b1fa242d-fa9a-45b6-8efb-7440f235a771 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:06:23.384222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1fa242d-fa9a-45b6-8efb-7440f235a771 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:23.384662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1fa242d-fa9a-45b6-8efb-7440f235a771 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:23.385418 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1fa242d-fa9a-45b6-8efb-7440f235a771 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:23.385844 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-b1fa242d-fa9a-45b6-8efb-7440f235a771 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:23.466527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-b1fa242d-fa9a-45b6-8efb-7440f235a771 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093898 Jun 16 12:06:23.467113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 534/1106] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 12:06:23 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:23.917371 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-fe5999dc-cb76-4f8a-bc4a-3d96ef9ba430 req-ff90cb16-c078-4ce9-805a-8194f4b58f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038951f4-f577-4c22-8896-817c1c290344", "tag": "f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:23.926933 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-fe5999dc-cb76-4f8a-bc4a-3d96ef9ba430 req-ff90cb16-c078-4ce9-805a-8194f4b58f00 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:23.929081 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-fe5999dc-cb76-4f8a-bc4a-3d96ef9ba430 req-ff90cb16-c078-4ce9-805a-8194f4b58f00 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:23.939331 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-fe5999dc-cb76-4f8a-bc4a-3d96ef9ba430 req-ff90cb16-c078-4ce9-805a-8194f4b58f00 service nova] Creating event network-changed:f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73 for instance 038951f4-f577-4c22-8896-817c1c290344 on hv-cinder-84614 Jun 16 12:06:23.944824 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-fe5999dc-cb76-4f8a-bc4a-3d96ef9ba430 req-ff90cb16-c078-4ce9-805a-8194f4b58f00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030941 Jun 16 12:06:23.945553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 573/1107] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:06:25.017662 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-bf19ca06-9b28-4b23-ae58-bdb36c44aea4 req-9b30035c-7677-4e1a-bd5d-cf6aa49f40e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64412494-6cf2-433f-903e-11ebf265d73b", "tag": "09787d46-aeff-414a-ab66-48787dd86c17"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:06:25.028116 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-bf19ca06-9b28-4b23-ae58-bdb36c44aea4 req-9b30035c-7677-4e1a-bd5d-cf6aa49f40e7 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:06:25.028645 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-bf19ca06-9b28-4b23-ae58-bdb36c44aea4 req-9b30035c-7677-4e1a-bd5d-cf6aa49f40e7 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:06:25.040494 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-bf19ca06-9b28-4b23-ae58-bdb36c44aea4 req-9b30035c-7677-4e1a-bd5d-cf6aa49f40e7 service nova] Creating event network-changed:09787d46-aeff-414a-ab66-48787dd86c17 for instance 64412494-6cf2-433f-903e-11ebf265d73b on hv-cinder-84614 Jun 16 12:06:25.046337 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-bf19ca06-9b28-4b23-ae58-bdb36c44aea4 req-9b30035c-7677-4e1a-bd5d-cf6aa49f40e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032954 Jun 16 12:06:25.046723 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 535/1108] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:01.204277 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=17 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:01.205021 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=64 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:01.209679 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-61dc2622-efcf-4d37-8f97-3cf338bb8c7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:01.210276 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-61dc2622-efcf-4d37-8f97-3cf338bb8c7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:01.216485 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61dc2622-efcf-4d37-8f97-3cf338bb8c7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:01.216938 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61dc2622-efcf-4d37-8f97-3cf338bb8c7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:01.217704 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61dc2622-efcf-4d37-8f97-3cf338bb8c7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:01.218142 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-61dc2622-efcf-4d37-8f97-3cf338bb8c7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:01.240917 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-61dc2622-efcf-4d37-8f97-3cf338bb8c7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/ips" status: 200 len: 148 microversion: 2.1 time: 0.038374 Jun 16 12:07:01.241488 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 574/1109] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 12:07:01 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:02.751358 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=19 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:02.752116 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=68 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:02.756864 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-d92a7bca-0db9-438b-8bd0-4b1c65debfbb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8357f45-da85-4f61-8a9f-a1d662778647"}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:02.757982 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-d92a7bca-0db9-438b-8bd0-4b1c65debfbb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:02.763839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d92a7bca-0db9-438b-8bd0-4b1c65debfbb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:02.765334 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d92a7bca-0db9-438b-8bd0-4b1c65debfbb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:02.765334 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d92a7bca-0db9-438b-8bd0-4b1c65debfbb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:02.765530 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-d92a7bca-0db9-438b-8bd0-4b1c65debfbb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:03.314002 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-d92a7bca-0db9-438b-8bd0-4b1c65debfbb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564087 Jun 16 12:07:03.314600 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 536/1110] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:07:02 2022] POST /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:10.788615 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8357f45-da85-4f61-8a9f-a1d662778647"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:10.789659 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:10.796101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:10.796540 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:10.797292 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:10.797718 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:10.874186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Invalid volume: volume d8357f45-da85-4f61-8a9f-a1d662778647 is already attached to instances: 64412494-6cf2-433f-903e-11ebf265d73b Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: POST /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments HTTP/1.1 Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 74 Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:07:10.875924 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {"volumeAttachment": {"volumeId": "d8357f45-da85-4f61-8a9f-a1d662778647"}} Jun 16 12:07:10.877637 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Invalid volume: volume d8357f45-da85-4f61-8a9f-a1d662778647 is already attached to instances: 64412494-6cf2-433f-903e-11ebf265d73b Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'server_id': '64412494-6cf2-433f-903e-11ebf265d73b', 'body': {'volumeAttachment': {'volumeId': 'd8357f45-da85-4f61-8a9f-a1d662778647'}}} Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d8357f45-da85-4f61-8a9f-a1d662778647 is already attached to instances: 64412494-6cf2-433f-903e-11ebf265d73b Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:07:10.879101 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d8357f45-da85-4f61-8a9f-a1d662778647 is already attached to instances: 64412494-6cf2-433f-903e-11ebf265d73b Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:10.880498 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:07:10.881789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:07:10.881789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:07:10.881789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:07:10.881789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d8357f45-da85-4f61-8a9f-a1d662778647 is already attached to instances: 64412494-6cf2-433f-903e-11ebf265d73b Jun 16 12:07:10.881789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:07:10.881789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 400 to user: Invalid volume: volume d8357f45-da85-4f61-8a9f-a1d662778647 is already attached to instances: 64412494-6cf2-433f-903e-11ebf265d73b {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:07:10.881789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-ea9d01f8-8bce-40c5-9bd0-77de9193f7c9 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093741 Jun 16 12:07:10.881789 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 575/1111] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:07:10 2022] POST /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:07:10.939436 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ae29478d-cfd0-4f32-8c84-858a998b6c9a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:10.940055 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-ae29478d-cfd0-4f32-8c84-858a998b6c9a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:10.946765 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae29478d-cfd0-4f32-8c84-858a998b6c9a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:10.947209 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae29478d-cfd0-4f32-8c84-858a998b6c9a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:10.948038 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae29478d-cfd0-4f32-8c84-858a998b6c9a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:10.948473 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-ae29478d-cfd0-4f32-8c84-858a998b6c9a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:11.026631 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-ae29478d-cfd0-4f32-8c84-858a998b6c9a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lazy-loading 'services' on Instance uuid 64412494-6cf2-433f-903e-11ebf265d73b {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:07:11.211769 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ae29478d-cfd0-4f32-8c84-858a998b6c9a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments/d8357f45-da85-4f61-8a9f-a1d662778647" status: 202 len: 0 microversion: 2.1 time: 0.272372 Jun 16 12:07:11.211769 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 537/1112] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:07:10 2022] DELETE /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments/d8357f45-da85-4f61-8a9f-a1d662778647 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:07:11.216914 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-17bcc99e-f566-492c-ac74-a0a25e9ebd8f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:11.217822 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-17bcc99e-f566-492c-ac74-a0a25e9ebd8f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:11.225141 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17bcc99e-f566-492c-ac74-a0a25e9ebd8f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:11.225843 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17bcc99e-f566-492c-ac74-a0a25e9ebd8f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:11.226609 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17bcc99e-f566-492c-ac74-a0a25e9ebd8f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:11.227039 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-17bcc99e-f566-492c-ac74-a0a25e9ebd8f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:11.256964 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-17bcc99e-f566-492c-ac74-a0a25e9ebd8f tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Jun 16 12:07:11.257513 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 576/1113] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:07:11 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:12.270203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-71aca1c9-d6e4-49eb-90cf-08e0dfc5f514 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:12.271175 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-71aca1c9-d6e4-49eb-90cf-08e0dfc5f514 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:12.277519 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-71aca1c9-d6e4-49eb-90cf-08e0dfc5f514 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:12.279782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-71aca1c9-d6e4-49eb-90cf-08e0dfc5f514 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:12.279782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-71aca1c9-d6e4-49eb-90cf-08e0dfc5f514 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:12.279782 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-71aca1c9-d6e4-49eb-90cf-08e0dfc5f514 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:12.307459 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-71aca1c9-d6e4-49eb-90cf-08e0dfc5f514 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042690 Jun 16 12:07:12.308029 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 538/1114] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:07:12 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:07:12.363676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-6a2aa07b-2e68-4984-bbb3-964848ef78c7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:12.364201 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6a2aa07b-2e68-4984-bbb3-964848ef78c7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:12.370767 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6a2aa07b-2e68-4984-bbb3-964848ef78c7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:12.371216 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6a2aa07b-2e68-4984-bbb3-964848ef78c7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:12.372012 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6a2aa07b-2e68-4984-bbb3-964848ef78c7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:12.372448 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-6a2aa07b-2e68-4984-bbb3-964848ef78c7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:12.398246 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-6a2aa07b-2e68-4984-bbb3-964848ef78c7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:07:12.682221 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-6a2aa07b-2e68-4984-bbb3-964848ef78c7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 204 len: 0 microversion: 2.1 time: 0.322108 Jun 16 12:07:12.682804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 577/1115] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:07:12 2022] DELETE /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:07:12.691608 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e4faf0a6-07eb-4a91-940b-712823ed3087 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:12.692258 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e4faf0a6-07eb-4a91-940b-712823ed3087 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:12.698440 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4faf0a6-07eb-4a91-940b-712823ed3087 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:12.698887 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4faf0a6-07eb-4a91-940b-712823ed3087 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:12.699809 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4faf0a6-07eb-4a91-940b-712823ed3087 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:12.700275 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e4faf0a6-07eb-4a91-940b-712823ed3087 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:12.832287 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e4faf0a6-07eb-4a91-940b-712823ed3087 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:12.839835 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e4faf0a6-07eb-4a91-940b-712823ed3087 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1679 microversion: 2.1 time: 0.152806 Jun 16 12:07:12.840427 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 539/1116] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:12 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:13.857346 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e6bcd46c-9690-4a55-a590-dff93862d7b0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:13.858152 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e6bcd46c-9690-4a55-a590-dff93862d7b0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:13.864560 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6bcd46c-9690-4a55-a590-dff93862d7b0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:13.865001 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6bcd46c-9690-4a55-a590-dff93862d7b0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:13.865755 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6bcd46c-9690-4a55-a590-dff93862d7b0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:13.866184 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e6bcd46c-9690-4a55-a590-dff93862d7b0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:14.002606 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e6bcd46c-9690-4a55-a590-dff93862d7b0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:14.010585 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e6bcd46c-9690-4a55-a590-dff93862d7b0 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1679 microversion: 2.1 time: 0.157430 Jun 16 12:07:14.011145 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 578/1117] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:13 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:15.032611 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-2edad03c-4b53-437b-9273-0cf6863b2163 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:15.033428 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-2edad03c-4b53-437b-9273-0cf6863b2163 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:15.040920 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2edad03c-4b53-437b-9273-0cf6863b2163 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:15.041364 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2edad03c-4b53-437b-9273-0cf6863b2163 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:15.042142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2edad03c-4b53-437b-9273-0cf6863b2163 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:15.042562 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-2edad03c-4b53-437b-9273-0cf6863b2163 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:15.366721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-2edad03c-4b53-437b-9273-0cf6863b2163 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:15.374564 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-2edad03c-4b53-437b-9273-0cf6863b2163 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 200 len: 1612 microversion: 2.1 time: 0.349786 Jun 16 12:07:15.375712 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 540/1118] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:15 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 1612 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:15.505750 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-a63c07a0-53b9-4331-97e2-0b7a1a4da770 req-975226a7-cf87-435c-a4fd-430bcd01d54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64412494-6cf2-433f-903e-11ebf265d73b", "name": "network-vif-deleted", "tag": "09787d46-aeff-414a-ab66-48787dd86c17"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:15.513816 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-a63c07a0-53b9-4331-97e2-0b7a1a4da770 req-975226a7-cf87-435c-a4fd-430bcd01d54b service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:15.514246 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-a63c07a0-53b9-4331-97e2-0b7a1a4da770 req-975226a7-cf87-435c-a4fd-430bcd01d54b service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:15.525777 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-a63c07a0-53b9-4331-97e2-0b7a1a4da770 req-975226a7-cf87-435c-a4fd-430bcd01d54b service nova] Creating event network-vif-deleted:09787d46-aeff-414a-ab66-48787dd86c17 for instance 64412494-6cf2-433f-903e-11ebf265d73b on hv-cinder-84614 Jun 16 12:07:15.530516 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-a63c07a0-53b9-4331-97e2-0b7a1a4da770 req-975226a7-cf87-435c-a4fd-430bcd01d54b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084426 Jun 16 12:07:15.531102 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 579/1119] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:07:16.391644 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:16.392285 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:16.398765 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:16.399222 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:16.399985 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:16.400415 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:16.414072 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b HTTP/1.1 Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:07:16.415672 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:07:16.418033 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '64412494-6cf2-433f-903e-11ebf265d73b'} Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:07:16.418899 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:07:16.420228 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:16.421679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:07:16.421679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-aceaf21c-2976-4657-8bb1-fd00187ed62c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 404 len: 111 microversion: 2.1 time: 0.029331 Jun 16 12:07:16.421679 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 541/1120] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:16 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:07:16.426997 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-1aee0085-c11b-4ad7-8e11-2a2b2e84e979 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '.version_select at 0x7f4334109040>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:16.511884 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-1aee0085-c11b-4ad7-8e11-2a2b2e84e979 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650218077" status: 202 len: 0 microversion: 2.1 time: 0.089583 Jun 16 12:07:16.512465 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 580/1121] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jun 16 12:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650218077 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:07:17.236994 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-ce546f2b-bf92-4809-9a81-e0e4aeb43a15 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: .version_select at 0x7f4334427ca0>, body: {"keypair": {"name": "tempest-keypair-1269467242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZxtK4syR4IrLgQY3qa8GQs+H6xybyReHZ880tZ84TxSS/M2Q/tsvxQYB7BSKfG+wMYwv+ORp5SwAKUPtbfcXO13zz6SMkYAty96Vc7wBdY+3QV+swK8nVYrSsHQqzgig=="}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:17.251156 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-ce546f2b-bf92-4809-9a81-e0e4aeb43a15 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:07:17.255523 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.quota [None req-ce546f2b-bf92-4809-9a81-e0e4aeb43a15 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for user 61dcabaa88464ba2aee72c163414d327 and project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'key_pairs'} {{(pid=125055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:07:17.357619 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-ce546f2b-bf92-4809-9a81-e0e4aeb43a15 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124388 Jun 16 12:07:17.358218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 542/1122] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 12:07:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:19.289838 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1327394054", "imageRef": "d4ac92f5-9c62-43e1-87fc-bead10df54dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5da113f2-855d-427a-92da-a197315b7e34"}], "security_groups": [{"name": "tempest-securitygroup--772703920"}], "key_name": "tempest-keypair-1269467242", "user_data": "}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:19.388660 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.network.neutron [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] validate_networks() for [('5da113f2-855d-427a-92da-a197315b7e34', None, None, None, None, None)] {{(pid=125054) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:07:19.802965 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Flavor limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:07:19.803377 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Image limits 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:07:19.803842 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Flavor pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:07:19.804267 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Image pref 0:0:0 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:07:19.804668 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.virt.hardware [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:07:19.813281 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:19.813722 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:19.814508 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:19.814933 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:19.830996 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:07:19.835339 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.quota [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Getting quotas for user 61dcabaa88464ba2aee72c163414d327 and project 4e4082fe2ecb4756bdc57454c80d3b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:07:19.845904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Going to run 1 instances... {{(pid=125054) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:07:19.848820 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4ac92f5-9c62-43e1-87fc-bead10df54dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:07:19.969701 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-eed1acfc-209d-4a9f-8294-dbb3348f5e80 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.685203 Jun 16 12:07:19.970400 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 581/1123] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 12:07:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:07:19.981996 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f2b7294d-032b-405f-af30-aced3947e729 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:19.982745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f2b7294d-032b-405f-af30-aced3947e729 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:20.042665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f2b7294d-032b-405f-af30-aced3947e729 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:20.049403 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f2b7294d-032b-405f-af30-aced3947e729 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1242 microversion: 2.1 time: 0.071855 Jun 16 12:07:20.049956 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 543/1124] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:19 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:21.066712 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-14878797-a4cb-41be-9a49-6e2553ed5d07 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:21.067261 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-14878797-a4cb-41be-9a49-6e2553ed5d07 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:21.073743 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-14878797-a4cb-41be-9a49-6e2553ed5d07 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:21.074186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-14878797-a4cb-41be-9a49-6e2553ed5d07 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:21.074941 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-14878797-a4cb-41be-9a49-6e2553ed5d07 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:21.075369 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-14878797-a4cb-41be-9a49-6e2553ed5d07 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:21.136760 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-14878797-a4cb-41be-9a49-6e2553ed5d07 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:21.144980 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-14878797-a4cb-41be-9a49-6e2553ed5d07 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1238 microversion: 2.1 time: 0.082649 Jun 16 12:07:21.145793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 582/1125] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:21 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:22.162983 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c8d0f274-b771-401f-9aa2-eabde4b08261 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:22.163652 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c8d0f274-b771-401f-9aa2-eabde4b08261 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:22.170560 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c8d0f274-b771-401f-9aa2-eabde4b08261 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:22.171019 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c8d0f274-b771-401f-9aa2-eabde4b08261 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:22.171796 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c8d0f274-b771-401f-9aa2-eabde4b08261 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:22.172255 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c8d0f274-b771-401f-9aa2-eabde4b08261 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:22.247241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-c8d0f274-b771-401f-9aa2-eabde4b08261 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:22.254847 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c8d0f274-b771-401f-9aa2-eabde4b08261 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1300 microversion: 2.1 time: 0.096494 Jun 16 12:07:22.255425 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 544/1126] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:22 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:23.272739 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-4f30f4d3-45be-4e3c-81fe-dc9039b8d73e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:23.276495 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-4f30f4d3-45be-4e3c-81fe-dc9039b8d73e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:23.279919 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4f30f4d3-45be-4e3c-81fe-dc9039b8d73e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:23.280367 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4f30f4d3-45be-4e3c-81fe-dc9039b8d73e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:23.281125 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4f30f4d3-45be-4e3c-81fe-dc9039b8d73e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:23.281563 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-4f30f4d3-45be-4e3c-81fe-dc9039b8d73e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:23.362028 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-8c2704e5-dbc0-4443-a821-14bf5eb847aa req-90064e33-bb4b-4511-8358-2ed648e89d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b547a075-6553-4eed-8631-84b290290bde", "tag": "d896fa76-d729-48d6-b985-cd02d2ecd849"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:23.371859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-8c2704e5-dbc0-4443-a821-14bf5eb847aa req-90064e33-bb4b-4511-8358-2ed648e89d74 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:23.376857 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-8c2704e5-dbc0-4443-a821-14bf5eb847aa req-90064e33-bb4b-4511-8358-2ed648e89d74 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:23.386687 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-8c2704e5-dbc0-4443-a821-14bf5eb847aa req-90064e33-bb4b-4511-8358-2ed648e89d74 service nova] Creating event network-changed:d896fa76-d729-48d6-b985-cd02d2ecd849 for instance b547a075-6553-4eed-8631-84b290290bde on hv-cinder-84614 Jun 16 12:07:23.391906 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-8c2704e5-dbc0-4443-a821-14bf5eb847aa req-90064e33-bb4b-4511-8358-2ed648e89d74 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033652 Jun 16 12:07:23.392522 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 545/1127] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:23.422804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-4f30f4d3-45be-4e3c-81fe-dc9039b8d73e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:23.431376 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-4f30f4d3-45be-4e3c-81fe-dc9039b8d73e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1367 microversion: 2.1 time: 0.163021 Jun 16 12:07:23.432323 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 583/1128] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:23 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:24.449326 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-8678f3d0-863a-488f-ad11-48f5d6c338af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:24.450026 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-8678f3d0-863a-488f-ad11-48f5d6c338af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:24.456221 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8678f3d0-863a-488f-ad11-48f5d6c338af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:24.456663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8678f3d0-863a-488f-ad11-48f5d6c338af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:24.457414 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8678f3d0-863a-488f-ad11-48f5d6c338af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:24.457846 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-8678f3d0-863a-488f-ad11-48f5d6c338af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:24.583862 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-8678f3d0-863a-488f-ad11-48f5d6c338af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:24.591241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8678f3d0-863a-488f-ad11-48f5d6c338af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1367 microversion: 2.1 time: 0.146573 Jun 16 12:07:24.591803 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 546/1129] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:24 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:25.608788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e9691505-12d7-4807-85e6-268717e252b8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:25.609433 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e9691505-12d7-4807-85e6-268717e252b8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:25.616456 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e9691505-12d7-4807-85e6-268717e252b8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:25.616890 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e9691505-12d7-4807-85e6-268717e252b8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:25.617645 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e9691505-12d7-4807-85e6-268717e252b8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:25.618072 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e9691505-12d7-4807-85e6-268717e252b8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:25.757312 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-e9691505-12d7-4807-85e6-268717e252b8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:25.764646 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e9691505-12d7-4807-85e6-268717e252b8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1367 microversion: 2.1 time: 0.159820 Jun 16 12:07:25.765204 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 584/1130] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:25 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:26.780460 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-1ce26d3c-546e-4ca5-a8e4-5eb570042267 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:26.781140 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-1ce26d3c-546e-4ca5-a8e4-5eb570042267 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:26.787627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1ce26d3c-546e-4ca5-a8e4-5eb570042267 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:26.788147 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1ce26d3c-546e-4ca5-a8e4-5eb570042267 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:26.788900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1ce26d3c-546e-4ca5-a8e4-5eb570042267 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:26.789325 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-1ce26d3c-546e-4ca5-a8e4-5eb570042267 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:26.918608 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-1ce26d3c-546e-4ca5-a8e4-5eb570042267 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:26.925889 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-1ce26d3c-546e-4ca5-a8e4-5eb570042267 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1367 microversion: 2.1 time: 0.149247 Jun 16 12:07:26.926446 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 547/1131] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:26 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:27.658663 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-652df40b-9dc9-4b4f-80e9-0f187b8b1df9 req-08085a8e-a84c-48b6-998e-c45c4cc2af4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b547a075-6553-4eed-8631-84b290290bde", "name": "network-vif-plugged", "status": "completed", "tag": "d896fa76-d729-48d6-b985-cd02d2ecd849"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:27.667392 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-652df40b-9dc9-4b4f-80e9-0f187b8b1df9 req-08085a8e-a84c-48b6-998e-c45c4cc2af4d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:27.667827 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-652df40b-9dc9-4b4f-80e9-0f187b8b1df9 req-08085a8e-a84c-48b6-998e-c45c4cc2af4d service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:27.679533 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-652df40b-9dc9-4b4f-80e9-0f187b8b1df9 req-08085a8e-a84c-48b6-998e-c45c4cc2af4d service nova] Creating event network-vif-plugged:d896fa76-d729-48d6-b985-cd02d2ecd849 for instance b547a075-6553-4eed-8631-84b290290bde on hv-cinder-84614 Jun 16 12:07:27.684670 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-652df40b-9dc9-4b4f-80e9-0f187b8b1df9 req-08085a8e-a84c-48b6-998e-c45c4cc2af4d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086261 Jun 16 12:07:27.685421 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 585/1132] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:27.942555 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-851e82ba-c55c-47b3-b820-75baf5403067 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:27.943242 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-851e82ba-c55c-47b3-b820-75baf5403067 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:27.949652 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-851e82ba-c55c-47b3-b820-75baf5403067 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:27.951801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-851e82ba-c55c-47b3-b820-75baf5403067 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:27.951801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-851e82ba-c55c-47b3-b820-75baf5403067 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:27.951801 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-851e82ba-c55c-47b3-b820-75baf5403067 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:28.094643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-851e82ba-c55c-47b3-b820-75baf5403067 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:28.102531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-851e82ba-c55c-47b3-b820-75baf5403067 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1367 microversion: 2.1 time: 0.163878 Jun 16 12:07:28.103107 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 548/1133] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:27 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:29.120996 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-9ae84ede-1881-48bb-8c34-926a88d74d12 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:29.121724 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-9ae84ede-1881-48bb-8c34-926a88d74d12 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:29.128544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9ae84ede-1881-48bb-8c34-926a88d74d12 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:29.128994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9ae84ede-1881-48bb-8c34-926a88d74d12 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:29.129749 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9ae84ede-1881-48bb-8c34-926a88d74d12 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:29.130184 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-9ae84ede-1881-48bb-8c34-926a88d74d12 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:29.257181 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-9ae84ede-1881-48bb-8c34-926a88d74d12 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:29.264481 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-9ae84ede-1881-48bb-8c34-926a88d74d12 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1367 microversion: 2.1 time: 0.147740 Jun 16 12:07:29.265040 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 586/1134] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:29 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:30.281014 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-a9a4dbab-3a92-4757-bd83-874eb450c0c1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:30.281623 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-a9a4dbab-3a92-4757-bd83-874eb450c0c1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:30.284050 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell0:SELECT=6 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:30.288836 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a9a4dbab-3a92-4757-bd83-874eb450c0c1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:30.295529 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a9a4dbab-3a92-4757-bd83-874eb450c0c1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:30.295529 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a9a4dbab-3a92-4757-bd83-874eb450c0c1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:30.295529 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-a9a4dbab-3a92-4757-bd83-874eb450c0c1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:30.418784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-a9a4dbab-3a92-4757-bd83-874eb450c0c1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:30.426849 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-a9a4dbab-3a92-4757-bd83-874eb450c0c1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1557 microversion: 2.1 time: 0.149106 Jun 16 12:07:30.427412 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 549/1135] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:30 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:07:30.442754 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-323e8eda-884f-4498-96be-ce233cda2a51 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:30.443270 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-323e8eda-884f-4498-96be-ce233cda2a51 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:30.445161 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=2 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:30.445804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell0:SELECT=6 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:30.450962 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-323e8eda-884f-4498-96be-ce233cda2a51 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:30.451432 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-323e8eda-884f-4498-96be-ce233cda2a51 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:30.452228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-323e8eda-884f-4498-96be-ce233cda2a51 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:30.452656 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-323e8eda-884f-4498-96be-ce233cda2a51 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:30.533673 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-323e8eda-884f-4498-96be-ce233cda2a51 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094689 Jun 16 12:07:30.534262 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 587/1136] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 12:07:30 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:31.525784 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-6c371720-0efa-4917-96fb-474fdeb1d063 req-4ff0fd00-0d7d-4454-9b1e-de9e2c8de045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b547a075-6553-4eed-8631-84b290290bde", "tag": "d896fa76-d729-48d6-b985-cd02d2ecd849"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:31.534661 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-6c371720-0efa-4917-96fb-474fdeb1d063 req-4ff0fd00-0d7d-4454-9b1e-de9e2c8de045 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:31.535192 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-6c371720-0efa-4917-96fb-474fdeb1d063 req-4ff0fd00-0d7d-4454-9b1e-de9e2c8de045 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:31.549910 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-6c371720-0efa-4917-96fb-474fdeb1d063 req-4ff0fd00-0d7d-4454-9b1e-de9e2c8de045 service nova] Creating event network-changed:d896fa76-d729-48d6-b985-cd02d2ecd849 for instance b547a075-6553-4eed-8631-84b290290bde on hv-cinder-84614 Jun 16 12:07:31.556096 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-6c371720-0efa-4917-96fb-474fdeb1d063 req-4ff0fd00-0d7d-4454-9b1e-de9e2c8de045 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096201 Jun 16 12:07:31.556798 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 550/1137] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:51.889940 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-9204f7cf-e3f5-48e3-9c1c-53ff3786e6b7 req-ad9b37ce-745a-4885-adfa-d819c55b4de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038951f4-f577-4c22-8896-817c1c290344", "tag": "f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:51.892509 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:51.893469 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:51.894856 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:51.895525 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:51.898053 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d6a1d101-712e-423d-8035-5b656cea248a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:51.898536 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d6a1d101-712e-423d-8035-5b656cea248a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:51.901595 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-9204f7cf-e3f5-48e3-9c1c-53ff3786e6b7 req-ad9b37ce-745a-4885-adfa-d819c55b4de7 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:51.902031 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-9204f7cf-e3f5-48e3-9c1c-53ff3786e6b7 req-ad9b37ce-745a-4885-adfa-d819c55b4de7 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:51.904911 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6a1d101-712e-423d-8035-5b656cea248a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:51.905364 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6a1d101-712e-423d-8035-5b656cea248a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:51.906131 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6a1d101-712e-423d-8035-5b656cea248a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:51.906557 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d6a1d101-712e-423d-8035-5b656cea248a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:51.916383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-9204f7cf-e3f5-48e3-9c1c-53ff3786e6b7 req-ad9b37ce-745a-4885-adfa-d819c55b4de7 service nova] Creating event network-changed:f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73 for instance 038951f4-f577-4c22-8896-817c1c290344 on hv-cinder-84614 Jun 16 12:07:51.921494 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-9204f7cf-e3f5-48e3-9c1c-53ff3786e6b7 req-ad9b37ce-745a-4885-adfa-d819c55b4de7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035604 Jun 16 12:07:51.922626 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 551/1138] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:51.933024 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d6a1d101-712e-423d-8035-5b656cea248a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:07:52.209568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d6a1d101-712e-423d-8035-5b656cea248a tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "DELETE /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 204 len: 0 microversion: 2.1 time: 0.325809 Jun 16 12:07:52.211201 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 588/1139] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:07:51 2022] DELETE /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:07:52.227143 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e96a8ea9-dd60-4d9c-94ec-e6446ba95847 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:52.227844 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e96a8ea9-dd60-4d9c-94ec-e6446ba95847 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:52.235877 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e96a8ea9-dd60-4d9c-94ec-e6446ba95847 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:52.237621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e96a8ea9-dd60-4d9c-94ec-e6446ba95847 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:52.237621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e96a8ea9-dd60-4d9c-94ec-e6446ba95847 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:52.237621 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e96a8ea9-dd60-4d9c-94ec-e6446ba95847 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:52.374305 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e96a8ea9-dd60-4d9c-94ec-e6446ba95847 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:52.382859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e96a8ea9-dd60-4d9c-94ec-e6446ba95847 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1580 microversion: 2.1 time: 0.167374 Jun 16 12:07:52.383635 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 552/1140] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:52 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1580 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:53.400568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d3ccb5af-70e0-4070-89ae-a3913d7f79f0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:53.401268 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-d3ccb5af-70e0-4070-89ae-a3913d7f79f0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:53.408875 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d3ccb5af-70e0-4070-89ae-a3913d7f79f0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:53.409321 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d3ccb5af-70e0-4070-89ae-a3913d7f79f0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:53.414147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d3ccb5af-70e0-4070-89ae-a3913d7f79f0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:53.414147 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-d3ccb5af-70e0-4070-89ae-a3913d7f79f0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:53.543944 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-d3ccb5af-70e0-4070-89ae-a3913d7f79f0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:53.551388 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d3ccb5af-70e0-4070-89ae-a3913d7f79f0 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1580 microversion: 2.1 time: 0.155913 Jun 16 12:07:53.557402 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 589/1141] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:53 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:07:54.252704 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-4be193f3-548a-4aaf-85ff-6edf79fc5e03 req-8e9e15a1-0ec9-4317-a553-608254077f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038951f4-f577-4c22-8896-817c1c290344", "name": "network-vif-deleted", "tag": "f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:54.262852 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-4be193f3-548a-4aaf-85ff-6edf79fc5e03 req-8e9e15a1-0ec9-4317-a553-608254077f60 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:54.263282 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-4be193f3-548a-4aaf-85ff-6edf79fc5e03 req-8e9e15a1-0ec9-4317-a553-608254077f60 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:54.274441 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-4be193f3-548a-4aaf-85ff-6edf79fc5e03 req-8e9e15a1-0ec9-4317-a553-608254077f60 service nova] Creating event network-vif-deleted:f2eef528-ada7-4f7a-b7f7-6b0a68b5bb73 for instance 038951f4-f577-4c22-8896-817c1c290344 on hv-cinder-84614 Jun 16 12:07:54.279185 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-4be193f3-548a-4aaf-85ff-6edf79fc5e03 req-8e9e15a1-0ec9-4317-a553-608254077f60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030132 Jun 16 12:07:54.279704 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 553/1142] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:07:54.569527 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-87ebfbf3-fd39-4da0-8cd9-044e33915360 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:54.570149 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-87ebfbf3-fd39-4da0-8cd9-044e33915360 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:54.577011 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-87ebfbf3-fd39-4da0-8cd9-044e33915360 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:54.577454 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-87ebfbf3-fd39-4da0-8cd9-044e33915360 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:54.578431 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-87ebfbf3-fd39-4da0-8cd9-044e33915360 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:54.578868 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-87ebfbf3-fd39-4da0-8cd9-044e33915360 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:54.647676 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-87ebfbf3-fd39-4da0-8cd9-044e33915360 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:54.655813 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-87ebfbf3-fd39-4da0-8cd9-044e33915360 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 200 len: 1226 microversion: 2.1 time: 0.090630 Jun 16 12:07:54.656345 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 590/1143] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:54 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:07:55.674151 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:55.674852 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 038951f4-f577-4c22-8896-817c1c290344] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:55.681149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:55.681593 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:55.682356 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:55.682797 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:55.696237 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] HTTP exception thrown: Instance 038951f4-f577-4c22-8896-817c1c290344 could not be found. Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Request method failure captured: Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 HTTP/1.1 Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxt-Xvxsep5dA8u4CCgG3njaeWh3awGfyGozF3kYATpsWxt_42mPDKK4zykXOHiYRzyWuD3JMN-5lSEY2YZPZgAKbCr72ZZNPwTuXJtos9VLZVFR7kEs0jqIu8IdQGODSdeV0Df2ogizu3u1pQkN0wBbBMJlxFiDkoRf8fOy3ssD01o Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:07:55.697865 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-TestVolumeBootPattern-887041558 Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: f6e726651e4c49b794f5c86e1fe51d9c Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 038951f4-f577-4c22-8896-817c1c290344 could not be found. Jun 16 12:07:55.699592 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '038951f4-f577-4c22-8896-817c1c290344'} Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038951f4-f577-4c22-8896-817c1c290344 could not be found. Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:07:55.700696 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038951f4-f577-4c22-8896-817c1c290344 could not be found. Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038951f4-f577-4c22-8896-817c1c290344 could not be found. Jun 16 12:07:55.702142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:07:55.703618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Returning 404 to user: Instance 038951f4-f577-4c22-8896-817c1c290344 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:07:55.703618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e2828639-be0b-4b51-9a56-1a3fc97bd0ec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344" status: 404 len: 111 microversion: 2.1 time: 0.030436 Jun 16 12:07:55.703618 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 554/1144] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:55 2022] GET /compute/v2.1/servers/038951f4-f577-4c22-8896-817c1c290344 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:07:58.970370 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-7b6c5f77-0856-4fdf-9985-2c3d4660a582 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:58.970925 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7b6c5f77-0856-4fdf-9985-2c3d4660a582 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:58.971891 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-b325f581-1597-4b4f-822e-2d821065ad75 req-fb81cdb2-3f16-4740-bd58-a044e7a957f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8280b475-f6b8-4343-94ec-0e606c828d02", "tag": "6beb28f2-29cf-4f4d-9979-acede16177be"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:07:58.978166 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b6c5f77-0856-4fdf-9985-2c3d4660a582 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:58.978710 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b6c5f77-0856-4fdf-9985-2c3d4660a582 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:58.979559 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b6c5f77-0856-4fdf-9985-2c3d4660a582 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:58.980283 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-7b6c5f77-0856-4fdf-9985-2c3d4660a582 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:58.981989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-b325f581-1597-4b4f-822e-2d821065ad75 req-fb81cdb2-3f16-4740-bd58-a044e7a957f6 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:58.982650 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-b325f581-1597-4b4f-822e-2d821065ad75 req-fb81cdb2-3f16-4740-bd58-a044e7a957f6 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:58.994527 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-b325f581-1597-4b4f-822e-2d821065ad75 req-fb81cdb2-3f16-4740-bd58-a044e7a957f6 service nova] Creating event network-changed:6beb28f2-29cf-4f4d-9979-acede16177be for instance 8280b475-f6b8-4343-94ec-0e606c828d02 on hv-cinder-84614 Jun 16 12:07:58.999738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-b325f581-1597-4b4f-822e-2d821065ad75 req-fb81cdb2-3f16-4740-bd58-a044e7a957f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031687 Jun 16 12:07:59.000355 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 555/1145] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:07:59.008700 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-7b6c5f77-0856-4fdf-9985-2c3d4660a582 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:07:59.264361 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-7b6c5f77-0856-4fdf-9985-2c3d4660a582 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 204 len: 0 microversion: 2.1 time: 0.297990 Jun 16 12:07:59.264988 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 591/1146] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:07:58 2022] DELETE /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:07:59.273859 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-deb7dd7c-8fb0-4050-a768-8249f1c8d34b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:07:59.277954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-deb7dd7c-8fb0-4050-a768-8249f1c8d34b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:07:59.284988 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-deb7dd7c-8fb0-4050-a768-8249f1c8d34b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:59.285433 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-deb7dd7c-8fb0-4050-a768-8249f1c8d34b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:59.286236 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-deb7dd7c-8fb0-4050-a768-8249f1c8d34b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:07:59.286666 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-deb7dd7c-8fb0-4050-a768-8249f1c8d34b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:07:59.638512 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-deb7dd7c-8fb0-4050-a768-8249f1c8d34b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:07:59.646065 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-deb7dd7c-8fb0-4050-a768-8249f1c8d34b tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1579 microversion: 2.1 time: 0.376495 Jun 16 12:07:59.646627 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 556/1147] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:07:59 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1579 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:08:00.665878 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-431777dc-03ee-46e8-b4f1-4f144a17eb64 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:00.666607 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-431777dc-03ee-46e8-b4f1-4f144a17eb64 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:00.673388 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-431777dc-03ee-46e8-b4f1-4f144a17eb64 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:00.673833 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-431777dc-03ee-46e8-b4f1-4f144a17eb64 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:00.674602 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-431777dc-03ee-46e8-b4f1-4f144a17eb64 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:00.675031 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-431777dc-03ee-46e8-b4f1-4f144a17eb64 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:00.805280 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-431777dc-03ee-46e8-b4f1-4f144a17eb64 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:08:00.812648 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-431777dc-03ee-46e8-b4f1-4f144a17eb64 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1579 microversion: 2.1 time: 0.151664 Jun 16 12:08:00.813208 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 592/1148] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:00 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:08:01.336213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [req-1e03b020-97c5-442a-9135-bd9ef0a807f0 req-05484c5c-286f-4bf2-bc4f-94a8d330ab67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8280b475-f6b8-4343-94ec-0e606c828d02", "name": "network-vif-deleted", "tag": "6beb28f2-29cf-4f4d-9979-acede16177be"}]} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:08:01.344348 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-1e03b020-97c5-442a-9135-bd9ef0a807f0 req-05484c5c-286f-4bf2-bc4f-94a8d330ab67 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:01.344783 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [req-1e03b020-97c5-442a-9135-bd9ef0a807f0 req-05484c5c-286f-4bf2-bc4f-94a8d330ab67 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:01.355913 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.compute.server_external_events [req-1e03b020-97c5-442a-9135-bd9ef0a807f0 req-05484c5c-286f-4bf2-bc4f-94a8d330ab67 service nova] Creating event network-vif-deleted:6beb28f2-29cf-4f4d-9979-acede16177be for instance 8280b475-f6b8-4343-94ec-0e606c828d02 on hv-cinder-84614 Jun 16 12:08:01.360970 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [req-1e03b020-97c5-442a-9135-bd9ef0a807f0 req-05484c5c-286f-4bf2-bc4f-94a8d330ab67 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030505 Jun 16 12:08:01.361920 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 557/1149] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:08:01.829704 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:01.830314 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:01.836871 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:01.837318 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:01.838078 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:01.838511 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:01.874477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:01.874804 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:01.875247 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.objects.instance [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lazy-loading 'fault' on Instance uuid 8280b475-f6b8-4343-94ec-0e606c828d02 {{(pid=125054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:08:01.916137 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e726651e4c49b794f5c86e1fe51d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be7fa7276cb42d3a8b6dd0dd12cd784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:08:01.923730 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-11746256-2d7a-457a-86b0-4d8a34dcfdec tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 200 len: 1231 microversion: 2.1 time: 0.097948 Jun 16 12:08:01.929748 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 593/1150] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:01 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:08:02.942405 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:02.943149 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 8280b475-f6b8-4343-94ec-0e606c828d02] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:02.950943 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:02.951417 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:02.952203 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:02.952631 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:02.965773 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] HTTP exception thrown: Instance 8280b475-f6b8-4343-94ec-0e606c828d02 could not be found. Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Request method failure captured: Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 HTTP/1.1 Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxt-Xvxsep5dA8u4CCgG3njaeWh3awGfyGozF3kYATpsWxt_42mPDKK4zykXOHiYRzyWuD3JMN-5lSEY2YZPZgAKbCr72ZZNPwTuXJtos9VLZVFR7kEs0jqIu8IdQGODSdeV0Df2ogizu3u1pQkN0wBbBMJlxFiDkoRf8fOy3ssD01o Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:02.967368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: f6e726651e4c49b794f5c86e1fe51d9c Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 8280b475-f6b8-4343-94ec-0e606c828d02 could not be found. Jun 16 12:08:02.969114 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '8280b475-f6b8-4343-94ec-0e606c828d02'} Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8280b475-f6b8-4343-94ec-0e606c828d02 could not be found. Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:02.970018 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8280b475-f6b8-4343-94ec-0e606c828d02 could not be found. Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8280b475-f6b8-4343-94ec-0e606c828d02 could not be found. Jun 16 12:08:02.971617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:02.973181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Returning 404 to user: Instance 8280b475-f6b8-4343-94ec-0e606c828d02 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:02.973181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f11ec833-8fd1-4ea1-9007-1e69776f9d0f tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02" status: 404 len: 111 microversion: 2.1 time: 0.031162 Jun 16 12:08:02.973181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 558/1151] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:02 2022] GET /compute/v2.1/servers/8280b475-f6b8-4343-94ec-0e606c828d02 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:08:03.461910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:03.462406 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:03.469099 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:03.472070 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:03.472070 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:03.472070 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:03.484950 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] HTTP exception thrown: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Request method failure captured: Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: DELETE /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 HTTP/1.1 Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxt-Xvxsep5dA8u4CCgG3njaeWh3awGfyGozF3kYATpsWxt_42mPDKK4zykXOHiYRzyWuD3JMN-5lSEY2YZPZgAKbCr72ZZNPwTuXJtos9VLZVFR7kEs0jqIu8IdQGODSdeV0Df2ogizu3u1pQkN0wBbBMJlxFiDkoRf8fOy3ssD01o Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:03.486572 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: f6e726651e4c49b794f5c86e1fe51d9c Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.488275 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '05a1b425-5720-4f35-ad2e-89ae357c62c5'} Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:03.489230 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.491460 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.493154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Returning 404 to user: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:03.493154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2354d1a0-5f0b-46a8-9f9a-90af9cd26638 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "DELETE /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 404 len: 111 microversion: 2.1 time: 0.029981 Jun 16 12:08:03.493154 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 594/1152] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:08:03 2022] DELETE /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:08:03.497508 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:03.498113 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] [instance: 05a1b425-5720-4f35-ad2e-89ae357c62c5] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:03.504200 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:03.504628 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:03.505368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:03.505795 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:03.518702 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] HTTP exception thrown: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Request method failure captured: Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 HTTP/1.1 Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxt-Xvxsep5dA8u4CCgG3njaeWh3awGfyGozF3kYATpsWxt_42mPDKK4zykXOHiYRzyWuD3JMN-5lSEY2YZPZgAKbCr72ZZNPwTuXJtos9VLZVFR7kEs0jqIu8IdQGODSdeV0Df2ogizu3u1pQkN0wBbBMJlxFiDkoRf8fOy3ssD01o Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:03.520339 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4be7fa7276cb42d3a8b6dd0dd12cd784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4be7fa7276cb42d3a8b6dd0dd12cd784 Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-TestVolumeBootPattern-887041558 Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: f6e726651e4c49b794f5c86e1fe51d9c Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-TestVolumeBootPattern-887041558-project Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.522040 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '05a1b425-5720-4f35-ad2e-89ae357c62c5'} Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:03.523090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. Jun 16 12:08:03.524697 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:03.526720 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Returning 404 to user: Instance 05a1b425-5720-4f35-ad2e-89ae357c62c5 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:03.526720 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-28f953f8-fc7b-45df-b8b7-8a01c683d876 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5" status: 404 len: 111 microversion: 2.1 time: 0.028005 Jun 16 12:08:03.526720 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 559/1153] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:03 2022] GET /compute/v2.1/servers/05a1b425-5720-4f35-ad2e-89ae357c62c5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:08:05.089980 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-d8179956-3b93-4c98-8b46-35ab91c96444 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] Calling method '.version_select at 0x7f43344c1040>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:05.168342 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-d8179956-3b93-4c98-8b46-35ab91c96444 tempest-TestVolumeBootPattern-887041558 tempest-TestVolumeBootPattern-887041558-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1690805727" status: 202 len: 0 microversion: 2.1 time: 0.082076 Jun 16 12:08:05.168921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 595/1154] 10.222.0.40 () {58 vars in 1262 bytes} [Thu Jun 16 12:08:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1690805727 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:08:05.361855 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-53d37ebb-29d0-4de1-a160-0ff291ede71e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:05.362382 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-53d37ebb-29d0-4de1-a160-0ff291ede71e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:05.369491 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-53d37ebb-29d0-4de1-a160-0ff291ede71e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:05.370065 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-53d37ebb-29d0-4de1-a160-0ff291ede71e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:05.370836 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-53d37ebb-29d0-4de1-a160-0ff291ede71e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:05.371264 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-53d37ebb-29d0-4de1-a160-0ff291ede71e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:05.396050 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-53d37ebb-29d0-4de1-a160-0ff291ede71e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/ips" status: 200 len: 150 microversion: 2.1 time: 0.038720 Jun 16 12:08:05.396622 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 560/1155] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 12:08:05 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:08:06.989018 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2f283079-a8ee-4a71-a0b6-a0fe7d2c3efc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f98792d-ecd1-4c8a-873a-cad58f829c58"}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:08:06.990162 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2f283079-a8ee-4a71-a0b6-a0fe7d2c3efc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:06.998155 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2f283079-a8ee-4a71-a0b6-a0fe7d2c3efc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:06.998600 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2f283079-a8ee-4a71-a0b6-a0fe7d2c3efc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:06.999458 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2f283079-a8ee-4a71-a0b6-a0fe7d2c3efc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:06.999931 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2f283079-a8ee-4a71-a0b6-a0fe7d2c3efc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:07.697158 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2f283079-a8ee-4a71-a0b6-a0fe7d2c3efc tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "POST /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712622 Jun 16 12:08:07.697764 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 596/1156] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 12:08:06 2022] POST /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:08:15.275570 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-9bd6860f-5578-4483-be10-caa5213e35af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:15.276090 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-9bd6860f-5578-4483-be10-caa5213e35af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:15.282686 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9bd6860f-5578-4483-be10-caa5213e35af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:15.283123 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9bd6860f-5578-4483-be10-caa5213e35af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:15.283954 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9bd6860f-5578-4483-be10-caa5213e35af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:15.284368 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-9bd6860f-5578-4483-be10-caa5213e35af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:15.362265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-9bd6860f-5578-4483-be10-caa5213e35af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lazy-loading 'services' on Instance uuid b547a075-6553-4eed-8631-84b290290bde {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:08:15.606185 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-9bd6860f-5578-4483-be10-caa5213e35af tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-volume_attachments/3f98792d-ecd1-4c8a-873a-cad58f829c58" status: 202 len: 0 microversion: 2.1 time: 0.334796 Jun 16 12:08:15.606703 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 561/1157] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 12:08:15 2022] DELETE /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-volume_attachments/3f98792d-ecd1-4c8a-873a-cad58f829c58 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:08:15.616993 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-faaef87b-bfc5-4dc9-895e-6f56590102d1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:15.618057 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-faaef87b-bfc5-4dc9-895e-6f56590102d1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:15.624400 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-faaef87b-bfc5-4dc9-895e-6f56590102d1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:15.624849 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-faaef87b-bfc5-4dc9-895e-6f56590102d1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:15.625610 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-faaef87b-bfc5-4dc9-895e-6f56590102d1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:15.626044 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-faaef87b-bfc5-4dc9-895e-6f56590102d1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:15.655723 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-faaef87b-bfc5-4dc9-895e-6f56590102d1 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Jun 16 12:08:15.656304 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 597/1158] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:08:15 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:08:16.667251 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-65fa58c8-ad47-441c-b973-70e19787bc7c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:16.668265 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-65fa58c8-ad47-441c-b973-70e19787bc7c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:16.674906 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-65fa58c8-ad47-441c-b973-70e19787bc7c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:16.675342 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-65fa58c8-ad47-441c-b973-70e19787bc7c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:16.676121 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-65fa58c8-ad47-441c-b973-70e19787bc7c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:16.676556 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-65fa58c8-ad47-441c-b973-70e19787bc7c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:16.706184 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-65fa58c8-ad47-441c-b973-70e19787bc7c tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043363 Jun 16 12:08:16.706778 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 562/1159] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 12:08:16 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:08:16.763843 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-2f03f68c-2a5c-4e14-98cf-10a3b785afae tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:16.764356 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2f03f68c-2a5c-4e14-98cf-10a3b785afae tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:16.770786 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2f03f68c-2a5c-4e14-98cf-10a3b785afae tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:16.771232 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2f03f68c-2a5c-4e14-98cf-10a3b785afae tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:16.772010 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2f03f68c-2a5c-4e14-98cf-10a3b785afae tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:16.772436 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-2f03f68c-2a5c-4e14-98cf-10a3b785afae tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:16.797093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-2f03f68c-2a5c-4e14-98cf-10a3b785afae tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Going to try to terminate instance {{(pid=125054) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:08:17.012093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-2f03f68c-2a5c-4e14-98cf-10a3b785afae tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 204 len: 0 microversion: 2.1 time: 0.251712 Jun 16 12:08:17.012793 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 598/1160] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:08:16 2022] DELETE /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:08:17.020961 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-e8646396-ba41-42ed-9eb0-ab1fcd84f93a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:17.021597 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-e8646396-ba41-42ed-9eb0-ab1fcd84f93a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:17.029680 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8646396-ba41-42ed-9eb0-ab1fcd84f93a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:17.030117 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8646396-ba41-42ed-9eb0-ab1fcd84f93a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:17.030870 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8646396-ba41-42ed-9eb0-ab1fcd84f93a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:17.031296 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-e8646396-ba41-42ed-9eb0-ab1fcd84f93a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:17.165463 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-e8646396-ba41-42ed-9eb0-ab1fcd84f93a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:08:17.172900 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-e8646396-ba41-42ed-9eb0-ab1fcd84f93a tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1682 microversion: 2.1 time: 0.155706 Jun 16 12:08:17.173462 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 563/1161] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:17 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:08:18.190889 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-540bba36-b7c7-4d3d-a9b1-f2002e2b1ea8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:18.191575 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-540bba36-b7c7-4d3d-a9b1-f2002e2b1ea8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:18.198696 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-540bba36-b7c7-4d3d-a9b1-f2002e2b1ea8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:18.199136 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-540bba36-b7c7-4d3d-a9b1-f2002e2b1ea8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:18.199904 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-540bba36-b7c7-4d3d-a9b1-f2002e2b1ea8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:18.200335 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-540bba36-b7c7-4d3d-a9b1-f2002e2b1ea8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:18.218332 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:08:18.332994 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.policy [None req-540bba36-b7c7-4d3d-a9b1-f2002e2b1ea8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125054) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:08:18.340287 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-540bba36-b7c7-4d3d-a9b1-f2002e2b1ea8 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1682 microversion: 2.1 time: 0.153584 Jun 16 12:08:18.340839 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 599/1162] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:18 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:08:19.358268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-0e0955da-be45-4fc6-8328-c2b24abce0ed tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:19.358839 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-0e0955da-be45-4fc6-8328-c2b24abce0ed tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:19.365352 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0e0955da-be45-4fc6-8328-c2b24abce0ed tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:19.369768 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0e0955da-be45-4fc6-8328-c2b24abce0ed tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:19.369768 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0e0955da-be45-4fc6-8328-c2b24abce0ed tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:19.369768 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-0e0955da-be45-4fc6-8328-c2b24abce0ed tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:19.469532 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-0e0955da-be45-4fc6-8328-c2b24abce0ed tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:08:19.477845 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-0e0955da-be45-4fc6-8328-c2b24abce0ed tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1615 microversion: 2.1 time: 0.123441 Jun 16 12:08:19.478411 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 564/1163] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:19 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1615 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:08:19.665779 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [req-fbb7e443-a253-4cb8-a80f-540ab7f64eec req-4e5180c1-b2fb-4e47-ba1a-de260b91d732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b547a075-6553-4eed-8631-84b290290bde", "name": "network-vif-deleted", "tag": "d896fa76-d729-48d6-b985-cd02d2ecd849"}]} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:08:19.674349 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-fbb7e443-a253-4cb8-a80f-540ab7f64eec req-4e5180c1-b2fb-4e47-ba1a-de260b91d732 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:19.674788 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [req-fbb7e443-a253-4cb8-a80f-540ab7f64eec req-4e5180c1-b2fb-4e47-ba1a-de260b91d732 service nova] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:19.686301 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.compute.server_external_events [req-fbb7e443-a253-4cb8-a80f-540ab7f64eec req-4e5180c1-b2fb-4e47-ba1a-de260b91d732 service nova] Creating event network-vif-deleted:d896fa76-d729-48d6-b985-cd02d2ecd849 for instance b547a075-6553-4eed-8631-84b290290bde on hv-cinder-84614 Jun 16 12:08:19.692020 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [req-fbb7e443-a253-4cb8-a80f-540ab7f64eec req-4e5180c1-b2fb-4e47-ba1a-de260b91d732 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030192 Jun 16 12:08:19.693039 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 600/1164] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 12:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:08:20.495361 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:20.496133 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:20.502706 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:20.503199 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:20.504076 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:20.504681 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:20.538663 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:20.539099 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:20.539537 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.objects.instance [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lazy-loading 'fault' on Instance uuid b547a075-6553-4eed-8631-84b290290bde {{(pid=125055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:08:20.580922 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.policy [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dcabaa88464ba2aee72c163414d327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4082fe2ecb4756bdc57454c80d3b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125055) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:08:20.588277 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-f0a830eb-83e3-4c0f-9f77-87a53d2300c3 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 200 len: 1332 microversion: 2.1 time: 0.097154 Jun 16 12:08:20.588771 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 565/1165] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:20 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:08:21.606814 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:21.607507 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:21.613680 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:21.614123 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:21.614882 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:21.615317 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:21.630594 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde HTTP/1.1 Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:21.632869 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:21.634553 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'b547a075-6553-4eed-8631-84b290290bde'} Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:21.635518 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:21.637083 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:21.638487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:21.638487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c2fb9081-d241-44dc-a158-0b830a4f6ee7 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 404 len: 111 microversion: 2.1 time: 0.032086 Jun 16 12:08:21.638487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 601/1166] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:21 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:08:21.643549 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-94a7b876-f3b5-45e1-a6c8-30c95d7acc7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '.version_select at 0x7f4334288d30>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:21.721904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-94a7b876-f3b5-45e1-a6c8-30c95d7acc7e tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269467242" status: 202 len: 0 microversion: 2.1 time: 0.082350 Jun 16 12:08:21.722471 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 566/1167] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 12:08:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269467242 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:08:23.662866 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:23.665525 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:23.666379 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG dbcounter [-] [125054] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:08:23.671112 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:23.671552 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:23.672477 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:23.672909 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:23.687174 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: DELETE /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde HTTP/1.1 Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:23.688921 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.690708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': 'b547a075-6553-4eed-8631-84b290290bde'} Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:23.692186 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.693729 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.695239 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:23.695239 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c0698ecb-774a-4124-8eb4-143e2fae5b56 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 404 len: 111 microversion: 2.1 time: 0.031386 Jun 16 12:08:23.695239 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 602/1168] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:08:23 2022] DELETE /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:08:23.699267 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:23.699920 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: b547a075-6553-4eed-8631-84b290290bde] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:23.706439 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:23.706886 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:23.707636 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:23.708097 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:23.720777 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde HTTP/1.1 Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:23.722390 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.724162 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': 'b547a075-6553-4eed-8631-84b290290bde'} Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:23.725086 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. Jun 16 12:08:23.727383 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:23.728904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance b547a075-6553-4eed-8631-84b290290bde could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:23.728904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-c487a1d6-ae13-4b4d-a3f6-63f0ec04f207 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde" status: 404 len: 111 microversion: 2.1 time: 0.028811 Jun 16 12:08:23.728904 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 567/1169] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:23 2022] GET /compute/v2.1/servers/b547a075-6553-4eed-8631-84b290290bde => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:08:24.993416 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:24.993910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:25.000766 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:25.003579 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:25.003579 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:25.003579 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:25.031090 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: DELETE /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b HTTP/1.1 Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:25.032640 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.034228 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '64412494-6cf2-433f-903e-11ebf265d73b'} Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:25.035064 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.038840 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.040362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:25.040362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-c6810fd3-2f33-4628-82ad-57b1d9bcb092 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 404 len: 111 microversion: 2.1 time: 0.045401 Jun 16 12:08:25.040362 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 603/1170] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:08:24 2022] DELETE /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:08:25.042892 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:25.043502 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 64412494-6cf2-433f-903e-11ebf265d73b] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:25.045888 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:08:25.050617 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:25.051061 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:25.051820 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:25.052278 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:25.065872 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b HTTP/1.1 Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:25.067360 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.069081 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '64412494-6cf2-433f-903e-11ebf265d73b'} Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:25.069977 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. Jun 16 12:08:25.071461 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.072845 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 64412494-6cf2-433f-903e-11ebf265d73b could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:25.072845 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-696ead72-3aff-42d7-ad6e-9265579ce3cb tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b" status: 404 len: 111 microversion: 2.1 time: 0.030047 Jun 16 12:08:25.072845 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 568/1171] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:25 2022] GET /compute/v2.1/servers/64412494-6cf2-433f-903e-11ebf265d73b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:08:25.077829 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:25.078325 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:25.084517 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:25.084957 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:25.085708 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:25.086137 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:25.099144 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: DELETE /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 HTTP/1.1 Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:25.101407 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.103019 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '41e76b78-579a-4611-aba5-f4547af3d874'} Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:25.103956 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.105483 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.107014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:25.107014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-e624f503-9ac6-4458-a1f1-82a62d720724 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 404 len: 111 microversion: 2.1 time: 0.029110 Jun 16 12:08:25.107014 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 604/1172] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:08:25 2022] DELETE /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:08:25.111239 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:25.111901 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 41e76b78-579a-4611-aba5-f4547af3d874] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:25.118999 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:25.119440 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:25.120213 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:25.120643 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:25.135373 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 HTTP/1.1 Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:25.136903 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.138503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '41e76b78-579a-4611-aba5-f4547af3d874'} Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:25.139531 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. Jun 16 12:08:25.141181 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:25.142823 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 41e76b78-579a-4611-aba5-f4547af3d874 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:25.142823 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-bfde07ce-b3a0-4d36-9260-a79ccb7d6d78 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874" status: 404 len: 111 microversion: 2.1 time: 0.031076 Jun 16 12:08:25.142823 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 569/1173] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:25 2022] GET /compute/v2.1/servers/41e76b78-579a-4611-aba5-f4547af3d874 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:08:26.371666 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:26.372173 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.compute.api [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125054) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:26.378624 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:26.379075 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:26.379803 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:26.380253 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG oslo_concurrency.lockutils [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125054) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:26.393928 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: DELETE /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef HTTP/1.1 Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:26.395437 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: > Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.397093 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '4221add6-1a15-44e5-b48a-6a62e0a302ef'} Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:26.398453 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.400146 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.401798 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:26.401798 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-cd4cb994-e64d-4983-8802-f9683bed9342 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 404 len: 111 microversion: 2.1 time: 0.028901 Jun 16 12:08:26.401798 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 605/1174] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 12:08:26 2022] DELETE /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:08:26.404863 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Calling method '>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:26.405455 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.compute.api [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] [instance: 4221add6-1a15-44e5-b48a-6a62e0a302ef] Fetching instance by UUID {{(pid=125055) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:08:26.412307 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:26.412738 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:26.413597 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:08:26.414024 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG oslo_concurrency.lockutils [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Lock "568ef18a-4a90-4649-bd8e-4ab9e1d0bdd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:08:26.418423 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG dbcounter [-] [125055] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=125055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:08:26.427503 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] HTTP exception thrown: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Request method failure captured: Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef HTTP/1.1 Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqxwn85iop8Y55yKK6ar1jD3W3DcEERoI7yjAVeeOSmS0XXzrEPPZBnQfa1-BYSSv0d29nbsq0AVMHmktaNtYBfRuVm1SoHsVeo-N4JSPqBlqrnAPPU7Aan7TWJ1fkuw28VywfdCkHo7PlnZDoKFC8mJuUAk8eU2II0SRheLUAXmsUz4 Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:26.432721 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4e4082fe2ecb4756bdc57454c80d3b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: 4e4082fe2ecb4756bdc57454c80d3b40 Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101709014 Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 61dcabaa88464ba2aee72c163414d327 Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-AttachVolumeNegativeTest-101709014-project Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: > Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.434429 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '4221add6-1a15-44e5-b48a-6a62e0a302ef'} Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:26.435353 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. Jun 16 12:08:26.436918 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:26.438866 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] Returning 404 to user: Instance 4221add6-1a15-44e5-b48a-6a62e0a302ef could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:26.438866 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-78f87a8f-5198-4958-91c3-5d299735d768 tempest-AttachVolumeNegativeTest-101709014 tempest-AttachVolumeNegativeTest-101709014-project] 10.222.0.40 "GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef" status: 404 len: 111 microversion: 2.1 time: 0.029740 Jun 16 12:08:26.438866 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 570/1175] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 12:08:26 2022] GET /compute/v2.1/servers/4221add6-1a15-44e5-b48a-6a62e0a302ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:08:31.674363 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-89283ca5-14a3-42a7-bf64-c130d01555d0 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Action: 'create', calling method: .version_select at 0x7f4338c5d0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1217517616", "metadata": {"Type": "work"}}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-89283ca5-14a3-42a7-bf64-c130d01555d0 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Request method failure captured: Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 122 Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqx0_0MU26hWW1IT7Dm9VYOfjUrlck7whjRw760mrCOiA4XYQ7Zr5AERWH9wEA9E5feoSPswu7xeFgEtB0m4kbRIwau4AFciho0B7XWn_CJZ_YUDMkYQnjcxIQ1mETyGddqBIYhzTHzhl8FMnh42SpNC6XACuJbHhgAKN10rOL1Lujjo Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:31.704568 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 463f8bb9792c4b359195f8e36692f767 Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1217517616", "metadata": {"Type": "work"}}} Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: Jun 16 12:08:31.706257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1217517616', 'metadata': {'Type': 'work'}}}} Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise error Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:31.707307 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 12:08:31.709487 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 12:08:31.711639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 12:08:31.711639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.711639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-89283ca5-14a3-42a7-bf64-c130d01555d0 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:31.711639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-89283ca5-14a3-42a7-bf64-c130d01555d0 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.158026 Jun 16 12:08:31.711639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 606/1176] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jun 16 12:08:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:08:31.716182 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cb6f1970-b022-4ec3-b7e9-f4c9d27d5cec tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Action: 'create', calling method: .version_select at 0x7f433449d820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1222615856", "metadata": {"Type": "work"}}} {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cb6f1970-b022-4ec3-b7e9-f4c9d27d5cec tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Request method failure captured: Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 120 Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqx0_0MU26hWW1IT7Dm9VYOfjUrlck7whjRw760mrCOiA4XYQ7Zr5AERWH9wEA9E5feoSPswu7xeFgEtB0m4kbRIwau4AFciho0B7XWn_CJZ_YUDMkYQnjcxIQ1mETyGddqBIYhzTHzhl8FMnh42SpNC6XACuJbHhgAKN10rOL1Lujjo Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:31.719393 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 463f8bb9792c4b359195f8e36692f767 Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1222615856", "metadata": {"Type": "work"}}} Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: Jun 16 12:08:31.720993 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1222615856', 'metadata': {'Type': 'work'}}}} Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise error Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi '0' Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:31.721989 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 12:08:31.723689 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 12:08:31.725095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 12:08:31.725095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.725095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-cb6f1970-b022-4ec3-b7e9-f4c9d27d5cec tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:31.725095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-cb6f1970-b022-4ec3-b7e9-f4c9d27d5cec tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008492 Jun 16 12:08:31.725095 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 571/1177] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jun 16 12:08:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:08:31.729694 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b3f85d00-ff25-48f3-b13f-28c5463c471e tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Action: 'create', calling method: .version_select at 0x7f433431eee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-578787442", "metadata": {"Type": "work"}}} {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b3f85d00-ff25-48f3-b13f-28c5463c471e tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Request method failure captured: Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 118 Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqx0_0MU26hWW1IT7Dm9VYOfjUrlck7whjRw760mrCOiA4XYQ7Zr5AERWH9wEA9E5feoSPswu7xeFgEtB0m4kbRIwau4AFciho0B7XWn_CJZ_YUDMkYQnjcxIQ1mETyGddqBIYhzTHzhl8FMnh42SpNC6XACuJbHhgAKN10rOL1Lujjo Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:31.731951 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 463f8bb9792c4b359195f8e36692f767 Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-578787442", "metadata": {"Type": "work"}}} Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: Jun 16 12:08:31.733544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-578787442', 'metadata': {'Type': 'work'}}}} Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise error Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi '' Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:31.734524 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 12:08:31.736214 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 12:08:31.737574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 12:08:31.737574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.737574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-b3f85d00-ff25-48f3-b13f-28c5463c471e tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:31.737574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-b3f85d00-ff25-48f3-b13f-28c5463c471e tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007598 Jun 16 12:08:31.737574 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 607/1178] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jun 16 12:08:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:08:31.744041 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-065e4697-a81c-4234-ad35-3d87cdd53a67 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Calling method '.version_select at 0x7f43345015e0>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:31.772943 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-065e4697-a81c-4234-ad35-3d87cdd53a67 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] HTTP exception thrown: Volume tempest-invalid-960751013 could not be found. Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-065e4697-a81c-4234-ad35-3d87cdd53a67 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Request method failure captured: Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-960751013 HTTP/1.1 Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqx0_0MU26hWW1IT7Dm9VYOfjUrlck7whjRw760mrCOiA4XYQ7Zr5AERWH9wEA9E5feoSPswu7xeFgEtB0m4kbRIwau4AFciho0B7XWn_CJZ_YUDMkYQnjcxIQ1mETyGddqBIYhzTHzhl8FMnh42SpNC6XACuJbHhgAKN10rOL1Lujjo Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:31.774876 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 463f8bb9792c4b359195f8e36692f767 Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Volume tempest-invalid-960751013 could not be found. Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': 'tempest-invalid-960751013'} Jun 16 12:08:31.776568 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-960751013 could not be found. (HTTP 404) (Request-ID: req-de32f6cc-ef67-4380-999f-f6a891251df6) Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.777690 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:08:31.779218 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-960751013 could not be found. Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:31.780745 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-960751013 could not be found. Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-960751013 could not be found. Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-065e4697-a81c-4234-ad35-3d87cdd53a67 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Returning 404 to user: Volume tempest-invalid-960751013 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-065e4697-a81c-4234-ad35-3d87cdd53a67 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-960751013" status: 404 len: 98 microversion: 2.1 time: 0.036983 Jun 16 12:08:31.782268 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 572/1179] 10.222.0.40 () {58 vars in 1214 bytes} [Thu Jun 16 12:08:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-960751013 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 12:08:31.785544 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-a680951f-a4f9-4ade-ad67-5458cf5c2c2d tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003702 Jun 16 12:08:31.786027 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 608/1180] 10.222.0.40 () {58 vars in 1139 bytes} [Thu Jun 16 12:08:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 12:08:31.794241 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-8a9b725f-99c4-4e3a-a171-f7cbc3950572 tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003683 Jun 16 12:08:31.794717 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 573/1181] 10.222.0.40 () {58 vars in 1136 bytes} [Thu Jun 16 12:08:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 12:08:31.802384 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fbab7c2d-959a-421f-af2f-417bca46f4db tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Calling method '.version_select at 0x7f4336232a60>' {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:31.829910 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.wsgi [None req-fbab7c2d-959a-421f-af2f-417bca46f4db tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] HTTP exception thrown: Volume 4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 could not be found. Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fbab7c2d-959a-421f-af2f-417bca46f4db tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Request method failure captured: Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: request: DELETE /compute/v2.1/os-volumes/4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 HTTP/1.1 Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept: application/json Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Accept-Encoding: identity Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Connection: close Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Length: 0 Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Content-Type: application/json Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Host: 10.222.0.40 Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Openstack-System-Scope: None Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Auth-Token: gAAAAABiqx0_0MU26hWW1IT7Dm9VYOfjUrlck7whjRw760mrCOiA4XYQ7Zr5AERWH9wEA9E5feoSPswu7xeFgEtB0m4kbRIwau4AFciho0B7XWn_CJZ_YUDMkYQnjcxIQ1mETyGddqBIYhzTHzhl8FMnh42SpNC6XACuJbHhgAKN10rOL1Lujjo Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Id: None Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Domain-Name: None Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Identity-Status: Confirmed Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Is-Admin-Project: True Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Id: default Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Domain-Name: Default Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Project-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Role: member,reader Jun 16 12:08:31.831852 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Roles: member,reader Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-Tenant-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Id: default Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Domain-Name: Default Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Id: 463f8bb9792c4b359195f8e36692f767 Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: X-User-Name: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: method: Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: exception: Volume 4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 could not be found. Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: action_args: {'id': '4608cf07-d2eb-4a8a-b0e0-ef61c75d6931'} Jun 16 12:08:31.833466 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: {{(pid=125054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 could not be found. (HTTP 404) (Request-ID: req-c56899a8-dadb-432c-9317-b12c46b034ed) Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.834595 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:08:31.836588 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 could not be found. Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 12:08:31.839169 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 could not be found. Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 could not be found. Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: DEBUG nova.api.openstack.wsgi [None req-fbab7c2d-959a-421f-af2f-417bca46f4db tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Returning 404 to user: Volume 4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 could not be found. {{(pid=125054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO nova.api.openstack.requestlog [None req-fbab7c2d-959a-421f-af2f-417bca46f4db tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/4608cf07-d2eb-4a8a-b0e0-ef61c75d6931" status: 404 len: 109 microversion: 2.1 time: 0.034214 Jun 16 12:08:31.840795 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: [pid: 125054|app: 0|req: 609/1182] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 12:08:31 2022] DELETE /compute/v2.1/os-volumes/4608cf07-d2eb-4a8a-b0e0-ef61c75d6931 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:08:31.843375 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4f160a8b-6c8e-494d-b920-91a8a4d1ba7b tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Calling method '.version_select at 0x7f433449d550>' {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:08:31.870124 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.wsgi [None req-4f160a8b-6c8e-494d-b920-91a8a4d1ba7b tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] HTTP exception thrown: Volume 0b9968c8-1025-4047-84e4-e34ade9135c1 could not be found. Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4f160a8b-6c8e-494d-b920-91a8a4d1ba7b tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Request method failure captured: Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: request: GET /compute/v2.1/os-volumes/0b9968c8-1025-4047-84e4-e34ade9135c1 HTTP/1.1 Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept: application/json Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Accept-Encoding: identity Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Connection: close Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Length: 0 Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Content-Type: application/json Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Host: 10.222.0.40 Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Openstack-System-Scope: None Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: User-Agent: python-urllib3/1.26.9 Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Auth-Token: gAAAAABiqx0_0MU26hWW1IT7Dm9VYOfjUrlck7whjRw760mrCOiA4XYQ7Zr5AERWH9wEA9E5feoSPswu7xeFgEtB0m4kbRIwau4AFciho0B7XWn_CJZ_YUDMkYQnjcxIQ1mETyGddqBIYhzTHzhl8FMnh42SpNC6XACuJbHhgAKN10rOL1Lujjo Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Id: None Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Domain-Name: None Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Identity-Status: Confirmed Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Is-Admin-Project: True Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Id: default Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Domain-Name: Default Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Project-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Role: member,reader Jun 16 12:08:31.872101 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Roles: member,reader Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa38fcf593f14dc1a22d63a4e9134f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Id: fa38fcf593f14dc1a22d63a4e9134f7e Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-Tenant-Name: tempest-VolumesNegativeTest-622197986 Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Id: default Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Domain-Name: Default Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Id: 463f8bb9792c4b359195f8e36692f767 Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: X-User-Name: tempest-VolumesNegativeTest-622197986-project Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: method: Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: exception: Volume 0b9968c8-1025-4047-84e4-e34ade9135c1 could not be found. Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: action_args: {'id': '0b9968c8-1025-4047-84e4-e34ade9135c1'} Jun 16 12:08:31.873744 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: {{(pid=125055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b9968c8-1025-4047-84e4-e34ade9135c1 could not be found. (HTTP 404) (Request-ID: req-5f102617-a7a6-43b4-9bff-ba0a5eae5384) Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.874750 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:08:31.876212 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b9968c8-1025-4047-84e4-e34ade9135c1 could not be found. Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 12:08:31.877647 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b9968c8-1025-4047-84e4-e34ade9135c1 could not be found. Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b9968c8-1025-4047-84e4-e34ade9135c1 could not be found. Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: ERROR nova.api.openstack.wsgi Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: DEBUG nova.api.openstack.wsgi [None req-4f160a8b-6c8e-494d-b920-91a8a4d1ba7b tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] Returning 404 to user: Volume 0b9968c8-1025-4047-84e4-e34ade9135c1 could not be found. {{(pid=125055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO nova.api.openstack.requestlog [None req-4f160a8b-6c8e-494d-b920-91a8a4d1ba7b tempest-VolumesNegativeTest-622197986 tempest-VolumesNegativeTest-622197986-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0b9968c8-1025-4047-84e4-e34ade9135c1" status: 404 len: 109 microversion: 2.1 time: 0.034139 Jun 16 12:08:31.879070 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: [pid: 125055|app: 0|req: 574/1183] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 12:08:31 2022] GET /compute/v2.1/os-volumes/0b9968c8-1025-4047-84e4-e34ade9135c1 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:11:13.199152 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:11:13.199771 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Thu Jun 16 12:11:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:11:14.835665 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:11:14.836190 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Thu Jun 16 12:11:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:11:15.462831 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:11:15.463052 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Thu Jun 16 12:11:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:11:35.336736 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:11:35.337444 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Thu Jun 16 12:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:12:57.845416 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:12:57.845943 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Thu Jun 16 12:12:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:13:19.711084 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:13:19.711639 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Thu Jun 16 12:13:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:14:33.207523 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:14:33.208257 dv-cinder-846146-2-iscsi devstack@n-api.service[125054]: Thu Jun 16 12:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:14:34.845649 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:14:34.846142 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Thu Jun 16 12:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:14:35.472873 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:14:35.473108 dv-cinder-846146-2-iscsi devstack@n-api.service[125055]: Thu Jun 16 12:14:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!